20 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Cory Dransfeldt	2d4efec184	chore: add FriendlyCrawler to apache.conf.txt	2024-04-08 12:41:19 -07:00
Cory Dransfeldt	d6d40989f4	chore: add FriendlyCrawler to robots.txt	2024-04-08 12:40:59 -07:00
Cory Dransfeldt	74e4f64d89	chore: create nginx.conf.txt	2024-04-08 12:27:59 -07:00
Cory Dransfeldt	609de2af12	chore: create apache.conf.txt	2024-04-08 12:26:04 -07:00
Cory Dransfeldt	47fc45f2f9	chore: add PiplBot	2024-04-06 20:25:28 -07:00
Cory Dransfeldt	46c8c9adb3	chore: add Meltwater	2024-04-03 08:56:30 -07:00
Cory Dransfeldt	c8a6d7f02d	chore: add Seekr	2024-04-03 08:56:12 -07:00
Cory Dransfeldt	bdf10968fd	chore: add ai.txt	2024-04-01 09:56:10 -07:00
Cory Dransfeldt	d7064d23fe	chore: additional resources	2024-04-01 09:55:46 -07:00
Cory Dransfeldt	5e02ebc168	chore: update README	2024-03-29 12:14:48 -07:00
Cory Dransfeldt	2d1c4707aa	Merge pull request #2 from Explosion-Scratch/patch-1	2024-03-28 09:15:51 -07:00
--Explosion--	3e57b5ab5d	Add GoogleOther ... Used by Google to crawl for internal research and development. It’s unknown what exactly this entails, but is a generic user agent that is used when no other appropriate user agent is available. Documentation available from Google: https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers	2024-03-28 10:00:58 -05:00
Cory Dransfeldt	543dfc8452	Merge pull request #1 from glyn/logo ... Add logo	2024-03-28 07:26:14 -07:00
Glyn Normington	780d772d53	Scale down logo	2024-03-28 09:11:49 +00:00
Glyn Normington	290d603b06	Reduce logo size	2024-03-28 09:09:29 +00:00
Glyn Normington	a71da3ecc4	Add logo	2024-03-28 09:07:58 +00:00
Cory Dransfeldt	297071a664	Update robots.txt	2024-03-27 11:41:12 -07:00
Cory Dransfeldt	8aeddbdce8	Create robots.txt	2024-03-27 10:59:01 -07:00
Cory Dransfeldt	be9d22abed	Create README.md	2024-03-27 10:58:49 -07:00
Cory Dransfeldt	400e0141db	Initial commit	2024-03-27 10:48:29 -07:00