Robots are typically search engines, such as Google, that are just recording all the pages so they show up when searched for.
Comments on Profile Post by Linux