URL to Markdown

What the URL converter keeps

• Main content: readability-style extraction keeps the article and drops navigation, sidebars, banners and footers.
• Links: rewritten as absolute URLs, so they still work outside the page.
• Code blocks: with their language, plus tables, lists and images.
• Metadata: title, author, published date, site name and OpenGraph data (in the API's JSON response).
• Documents: links to PDF, DOCX, XLSX and PPTX files are downloaded and converted too.
• Share links: Google Docs, Sheets, Slides, Drive, Dropbox and GitHub links are turned into direct downloads.

Example output

A blog page with a nav bar, a cookie notice, the article and a footer. Converted from its URL:

# How Rate Limits Work

Rate limits protect APIs from overload. Most providers return HTTP `429 Too Many Requests` when the limit is exceeded, along with a `Retry-After` header.

## Token bucket

The token bucket algorithm refills tokens at a fixed rate. Each request consumes a token; when the bucket is empty, requests are rejected.

```csharp
var limiter = new TokenBucketRateLimiter(options);
```

## Best practices

- Use exponential backoff
- Cache responses
- Read the [limits documentation](https://blog.example.com/docs/limits)