Skip to content

Latest commit

 

History

History
89 lines (67 loc) · 2.88 KB

README.md

File metadata and controls

89 lines (67 loc) · 2.88 KB
Raw

User-Agent Lists

Sometimes you need change the User-Agent string used when making alot of requests to the same server(s) often.

  • Research Purposes ONLY

That can be a hard thing to do if you only know a handful of user agents.

Not to mention building your own comprehensive list of user agent strings takes time.

In the spirit of the rfc.bib project, this project aims to make a comprehensive set of User-Agent string lists available for all to use.

Usage

Download a list today free of charge

OR

Generate the lists yourself (Requires python 3.5)

  • [sudo] pip install -r requirements.txt
  • python useragents.py --all

For more options execute python useragents.py --help

List Info

Origins

The User-Agent lists made available by this repo come from

Flavors

All list provided by this repo come in two flavors namely csv and json.

Both flavors can be found in a directory of same name and both flavors share the same "keys".

Keys

ua_org_allagents.(csv|json)

  • description: The name of the browser/bot/etc using the User-Agent string
  • ua: The User-Agent string

techpatterns_com_useragentswitcher.(csv|json)

  • kind: Is the userof the User-Agent string a browser, mobile, spider
  • description: Name version (os) for the user of the User-Agent string
  • ua: The User-Agent string

[browser].(csv|json)

  • ua: The User-Agent string
  • version: The version of the browser using the User-Agent string
  • commonality: How common is this User-Agent string

User-Agents Included By Each List

ua_org_allagents.(csv|json) provides 2460 User-Agent strings comprised of

  • Web Crawlers / Robots
  • Browsers (Older)
  • Tools (Curl, etc)
  • Scanners

techpatterns_com_useragentswitcher.(csv|json) provides 830 User-Agent strings comprised of

  • Browsers - Windows
  • Browsers - Mac
  • Browsers - Linux, Browsers - Unix
  • Mobile Devices
  • Spiders
  • Miscellaneous

[browser].(csv|json) provides 1501 User-Agent strings specific to a browser

  • chrome
  • firefox
  • safari
  • opera
  • internet-explorer
  • android

User-Agents Included By Each List (patched by pankaj)

>>> from uagents import UserAgents
>>> firefox_ua = UserAgents(profile='firefox')
>>> chrome_ua = UserAgents(profile='chrome')
>>> firefox_ua.return_ua()
'Mozilla/5.0 (Windows NT 5.1; rv:7.0.1) Gecko/20100101 Firefox/7.0.1'
>>> chrome_ua.return_ua()
'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.113 Safari/537.36'
>>>

License

MIT