Back to selected workDeveloper tools / 04

OxyScrap.

From scattered products to structured data.

ROLE

Creator

BUILT WITH

Python / Data collection / Web

Visit project

OXYSCRAP / DATA PIPELINECONCEPT STUDY ↗

Scattered.
Structured.

product pages

Published catalogue

PRODUCTCATEGORYFORMAT

Product record AElectronics JSON

Product record BAccessories JSON

Product record CHome & living JSON

MAKE DATA MAKE SENSE.

The challenge.

Connect a locally operated collection process with a catalogue that makes the published product snapshot easy to browse.

The approach.

Python powers collection and local administration. A separate read-only web showcase presents the published retailer data.

The result.

A browsable published snapshot backed by a Python collection workflow. Data freshness depends on the published snapshot. The source is not currently publicly accessible.

KEEP EXPLORINGAtlas MD