No, you don't have to keep tightly to them. They're meant to inspire, not to restrict. As long as the location is Diagon Alley (which includes interiors of shops, cafes, The Leaky Cauldron) then that's fine