All projects

AI & data

Scraping DB

A Node.js tool that collects search results through SerpApi, stores them locally and exports them to Excel, CSV and JSON.

  • Individual project
export formats
3
modes: command line and web
2
separate modules
4

01Starting point

Context & mission

The problem

Copying search results into a spreadsheet by hand is slow and error-prone.

The mission

Automate collection and produce directly usable datasets.

My role

Designed and built on my own.

02Execution

What I did

  1. Collection

    Results retrieved through the SerpApi API.

  2. Local storage

    Data persisted through a dedicated database layer.

  3. Exports

    Datasets exported to Excel, CSV and JSON.

  4. Two ways to use it

    From the command line or a lightweight web interface; separate modules for the API, storage, arguments and export.

03Design

Architecture

The data flow
  1. CLI or web
  2. SerpApiserpapi.js
  3. Processing
  4. Storagedb.js
  5. ExportXLSX · CSV · JSON

04Impact

Results

  • Automated collection, from query to usable file.

05Wrap-up

Takeaways

What this project proves

That I split even a small tool into clear modules, each with a single responsibility.

06Technology

Full stack

  • Node.js
  • JavaScript
  • SerpApi
  • Excel
  • CSV
  • JSON