![]()
A) Advanced Interface B) Analysis & Investigation C) Automated Integration D) Artificial Intelligence
A) Sony B) Toyota C) LG D) Honda
A) R2-D2 B) EVE C) BOLT D) C-3PO
A) C-3PO B) Optimus Prime C) Robot B-9 D) WALL-E
A) I, Robot B) Do Androids Dream of Electric Sheep? C) Snow Crash D) Neuromancer
A) HAL 9000 B) Skynet C) Mother D) Ultron
A) Bender B) R2-D2 C) Johnny 5 D) Dalek
A) Algorithm B) Articulation C) Automation D) Anthropomorphism
A) iRobot B) Blue Origin C) Rethink Robotics D) Boston Dynamics
A) Programming by Demonstration B) Artificial Neural Networks C) Genetic Algorithms D) Deep Reinforcement Learning
A) Wireless Connectivity B) Social Networking C) Machine Learning D) Virtual Reality
A) Germany B) South Korea C) Japan D) China
A) CrawlerRules.json B) Robots.txt C) MetaTags.html D) Sitemap.xml
A) Tim Berners-Lee B) Martijn Koster C) Vint Cerf D) Charles Stross
A) RobotsNotWanted.txt B) CrawlerExclusion.txt C) WebBotRules.txt D) PageAccessControl.txt
A) Countering with security through obscurity B) Implementing CAPTCHA systems C) Deploying firewalls D) Using encryption
A) It has been used as a basis for legal action against non-compliant bot operators. B) Robots.txt is always ignored by courts in such cases. C) Legal cases have shown that robots.txt is irrelevant to bot operations. D) Courts mandate the creation of robots.txt files for all websites.
A) 100 B) 306 C) 50 D) 500
A) Internet Engineering Task Force (IETF) B) World Wide Web Consortium (W3C) C) Institute of Electrical and Electronics Engineers (IEEE) D) International Organization for Standardization (ISO)
A) Disallow B) Sitemap C) Allow D) Crawl-delay
A) Yes, if they are linked from another page that is crawled B) They only appear if the robots.txt file is missing C) Only if the site owner approves it manually D) No, they will never appear in search results
A) Content-Signal B) Disallow C) Sitemap D) Crawl-delay
A) BingBot B) Yandex C) Googlebot D) All crawlers
A) Facebook, Twitter, Instagram B) LinkedIn, WhatsApp, Telegram C) Ask, AOL, Baidu, Bing, DuckDuckGo, Kagi, Google, Yahoo!, Yandex D) Amazon, eBay, Alibaba
A) Use the same robots.txt for all subdomains B) Ignore robots.txt for subdomains C) Place a single robots.txt in the root directory D) Each subdomain must have its own robots.txt file
A) In the user's browser cache B) In the root of the web site hierarchy C) In the server's configuration files D) Inside each directory it applies to
A) Google, Facebook, Twitter B) Amazon, eBay, Alibaba C) Medium, Reddit, Yahoo D) LinkedIn, WhatsApp, Telegram
A) To improve server hardware B) To enhance multimedia playback C) To increase the number of visitors D) To prevent certain content from being misleading or irrelevant in search results
A) To indicate which portions of a website web crawlers are allowed to visit B) To display advertisements C) To store user login credentials D) To enhance website security through encryption
A) To encrypt data transmission B) To increase page load speed C) To manage which parts of a website are crawled and indexed D) To enhance visual design
A) RFC 7230 B) RFC 2616 C) RFC 9309 D) RFC 3986
A) Large file uploads by users B) The internet was small enough to maintain a complete list of all bots C) High bandwidth usage by video streaming D) Complex database queries
A) 2022 B) 1998 C) 2005 D) 2019
A) 256 kilobytes B) Unlimited C) 500 kibibytes (512000 bytes) D) 1 megabyte
A) A specific text-based format B) Binary code C) HTML tags D) JSON objects
A) The server returns an error 404 B) All web pages are automatically indexed C) The website is blocked from search engines D) Web robots assume that there are no limitations on crawling the entire site |