The Firefly text-to-image update joins a collaborative moodboard app and new features for Photoshop and Illustrator.

For years, websites included information about what kind of crawlers were not allowed on their site with a robots.txt file.