UiScraper is a user-friendly web application that simplifies the process of extracting data from websites. Built with Next.js, it provides an intuitive interface for defining selectors and effortlessly scraping the desired content.
- Visual Selector Creation: Easily define CSS selectors to target specific elements on a webpage.
- Nested Selectors: Support for extracting data from nested elements within a parent container.
- Array Extraction: Efficiently scrape lists of data by defining selectors as arrays.
- Attribute Targeting: Option to extract specific attributes (e.g., 'src', 'href') from selected elements.
- Real-time Preview: Instantly see the scraped data as you adjust your selectors.
- Code Generation: Generate code snippets in popular languages (e.g., Python, Node.js) for easy integration into your projects.
- Clone the repository:
git clone https://github.com/abdrahiman/uiscraper.git- Install dependencies:
cd uiscraper && npm install- Start the development server:
npm run dev- Open your browser and visit
http://localhost:3000
Demo: https://uiscraper.vercel.app
- Enter the URL of the website you want to scrape.
- Use the visual selector tool to highlight the elements you want to extract data from.
- Configure the selectors by specifying their names, types (array or single), and optional attributes.
- Click "Scrape" to preview the extracted data.
- Copy the generated code snippet to integrate the scraping logic into your own applications.
- Next.js: React framework for server-side rendering and static site generation.
- Tailwind CSS: Utility-first CSS framework for rapid UI development.
- jsdom: Fast and flexible HTML parser for Node.js.
Contributions are welcome! If you find any bugs or have suggestions for new features, please open an issue or submit a pull request.
This project is licensed under the MIT License.
Give a ⭐️ if this project helped you :)