Skip to content

README.md

Latest commit

 

History

History
97 lines (77 loc) · 4.18 KB

README.md

File metadata and controls

97 lines (77 loc) · 4.18 KB

Quick Recipes (Python)

Collection of quick automation recipes for common browser tasks.

Run on Intuned

Run on Intuned

APIs

API Description
download-file Download a file triggered by a button click
pagination Scrape data across paginated listings
upload-to-s3 Download a file and upload it to S3 in one step
capture-screenshots Capture a screenshot and upload it to S3
handle-load-more-button Scrape data by clicking a "Load More" button repeatedly
infinite-scrolling Scrape content loaded dynamically via infinite scrolling
handle-long-run Handle long-running scraping jobs with proper timeouts
scrape-without-selectors Use AI-based scraping without relying on CSS selectors

Getting started

Install dependencies

uv sync

If the intuned CLI is not installed, install it globally:

npm install -g @intuned/cli

After installing dependencies, intuned command should be available in your environment.

Prepare the project

Before running any API, provision and deploy the project first.

intuned dev provision
intuned dev deploy

Run an API

intuned dev run api download-file .parameters/api/download-file/default.json
intuned dev run api pagination .parameters/api/pagination/default.json
intuned dev run api upload-to-s3 .parameters/api/upload-to-s3/default.json
intuned dev run api capture-screenshots .parameters/api/capture-screenshots/default.json
intuned dev run api handle-load-more-button .parameters/api/handle-load-more-button/default.json
intuned dev run api infinite-scrolling .parameters/api/infinite-scrolling/default.json
intuned dev run api handle-long-run .parameters/api/handle-long-run/default.json
intuned dev run api scrape-without-selectors .parameters/api/scrape-without-selectors/default.json

Project structure

/
├── api/
│   ├── capture-screenshots.py             # Capture and upload screenshots
│   ├── download-file.py                   # Download files from triggers
│   ├── pagination.py                      # Scrape paginated data
│   ├── upload-to-s3.py                    # Download and upload to S3
│   ├── handle-load-more-button.py         # Handle "Load More" button pagination
│   ├── handle-long-run.py                 # Handle long-running scraping jobs
│   ├── infinite-scrolling.py              # Scrape pages with infinite scrolling
│   └── scrape-without-selectors.py        # AI-based scraping without selectors
├── intuned-resources/
│   └── jobs/                              # Job definitions for each API
├── .parameters/api/                       # Test parameters
├── Intuned.jsonc                          # Project config
├── pyproject.toml                         # Python dependencies
└── README.md

Related