Changelog

All notable changes to robots-txt will be documented in this file

2.3.0 - 2025-01-27

What's Changed

Update phpunit/phpunit requirement from ^9.0|^10.0 to ^11.5.2 by @dependabot in #59
"Allow" Handling by @Dwarfex in #60

New Contributors

@Dwarfex made their first contribution in #60

Full Changelog: https://github.com/spatie/robots-txt/compare/2.2.3...2.3.0

2.2.3 - 2024-10-22

What's Changed

avoid expensive queries that do not change certain results by @elcapo in #53

New Contributors

@elcapo made their first contribution in #53

Full Changelog: https://github.com/spatie/robots-txt/compare/2.2.2...2.2.3

2.2.2 - 2024-09-25

What's Changed

Bump actions/checkout from 2 to 4 by @dependabot in #47
Bump stefanzweifel/git-auto-commit-action from 4 to 5 by @dependabot in #48
Fixes "case-sensitive" URI matching for Disallow rules in robots.txt by @mattfo0 in #46

New Contributors

@dependabot made their first contribution in #47
@mattfo0 made their first contribution in #46

Full Changelog: https://github.com/spatie/robots-txt/compare/2.2.1...2.2.2

2.2.1 - 2024-08-09

What's Changed

Add missing use statement for InvalidArgumentException by @remcom in #44

New Contributors

@remcom made their first contribution in #44

Full Changelog: https://github.com/spatie/robots-txt/compare/2.2.0...2.2.1

2.2.0 - 2024-04-22

What's Changed

optionally allow partial matches and global groups by @resohead in #43

New Contributors

@resohead made their first contribution in #43

Full Changelog: https://github.com/spatie/robots-txt/compare/2.1.0...2.2.0

2.1.0 - 2024-04-19

What's Changed

Add some efficiencies to prevent unnecessary requests by @tsjason in #42

New Contributors

@tsjason made their first contribution in #42

Full Changelog: https://github.com/spatie/robots-txt/compare/2.0.3...2.1.0

2.0.3 - 2023-11-22

What's Changed

Update .gitattributes and ignore php_cs cache by @angeljqv in #36
Update PHPUnit config to latest schema by @patinthehat in #39
Add PHP 8.2 Support by @patinthehat in #38
Fix deprecation message by @buismaarten in #41

New Contributors

@angeljqv made their first contribution in #36
@buismaarten made their first contribution in #41

Full Changelog: https://github.com/spatie/robots-txt/compare/2.0.2...2.0.3

2.0.2 - 2022-05-18

What's Changed

Match meta tag for single quotes, often used by Wordpress sites by @gjportegies in #35

New Contributors

@gjportegies made their first contribution in #35

Full Changelog: https://github.com/spatie/robots-txt/compare/2.0.1...2.0.2

2.0.1 - 2021-05-06

added x-robots-tag: none (#32)

2.0.0 - 2021-03-28

require PHP 8+
drop support for PHP 7.x
convert syntax to PHP 8
remove deprecated methods
use php-cs-fixer & github workflow

1.0.10 - 2020-12-08

handle multiple user-agent (#29)

1.0.9 - 2020-11-27

add support for PHP 8.0 + move to GitHub actions (#27)

1.0.8 - 2020-09-12

make user agent checks case-insensitive

1.0.7 - 2020-04-29

fix find robots meta tag line if minified code (#23)

1.0.6 - 2020-04-07

fix headers checking (nofollow, noindex) for custom userAgent (#21)

1.0.5 - 2019-08-08

improvements around handling of wildcards, end-of-string, query string

1.0.4 - 2019-08-07

improve readability

1.0.3 - 2019-03-11

fix parsing robotstxt urls with keywords (#14)

1.0.2 - 2019-01-11

make robots.txt check case insensitive

1.0.1 - 2018-05-07

prevent exception if the domain has no robots.txt

1.0.0 - 2018-05-07

initial release