## [1.5.1](https://github.com/BuilderIO/gpt-crawler/compare/v1.5.0...v1.5.1) (2025-01-23)

### Bug Fixes

* correctly set cookies ([567ab0b0](https://github.com/BuilderIO/gpt-crawler/commit/567ab0b0a538032d02743ae3ecc51dfdc0fdb5c6))

fix: correctly set cookies

Revert "feat: proxy support"

feat: proxy support

# [1.5.0](https://github.com/BuilderIO/gpt-crawler/compare/v1.4.0...v1.5.0) (2024-07-05)

### Features

* git clone depth limit in docker ([87767dbd](https://github.com/BuilderIO/gpt-crawler/commit/87767dbda99b3259d44ec2c02dceb3a59bb2ca3c))

chore: git clone depth limit in docker

Remove references to CLI

fix: #147 Set `purgeOnStart: true` to process multiple sites as a server

chore: update README.md

a -> an

# [1.4.0](https://github.com/BuilderIO/gpt-crawler/compare/v1.3.0...v1.4.0) (2024-01-15)

### Bug Fixes

* linting ([0f4e58b4](https://github.com/BuilderIO/gpt-crawler/commit/0f4e58b400eab312e7b595d7a2472bae93055415))

### Features

* add server api readme docs ([717e625f](https://github.com/BuilderIO/gpt-crawler/commit/717e625f47257bdbd96437acb7242bcd28c233ba))

feat: add server api readme docs

Update config.ts to add maxTokens default

# [1.3.0](https://github.com/BuilderIO/gpt-crawler/compare/v1.2.1...v1.3.0) (2024-01-06)

### Features

* add exclude pattern for links in config ([16443ed9](https://github.com/BuilderIO/gpt-crawler/commit/16443ed9501624de40d921b8e47e4c35f15bf6b4))

feat: add exclude pattern for links in config

feat: account for other sitemap names

chore: add release notes generator

fix: add run swagger js when start server

chore(cicd): setup test pipeline