Skip to content

Observable data collection for e-commerce

Web data collection that follows the real page journey.

Model the visible browser interactions behind dynamic product data, validate every transformation and monitor each run before the result reaches a pricing decision.

Single pages · Lists · Search results · CSV/XML feeds
reevals.app / collection / run-40218 Illustrative workflow
  1. 01
    Open product pageHTTP 200 · 420 ms
  2. 02
    Select colour: blackVisible page control
  3. 03
    Wait for price responseDOM · network idle
  4. 04
    Capture required fieldsPrice · stock · shipping
  5. 05
    Validate and storePreview before publish
store.example / outdoor-grillLive page state
Outdoor grill 60 cm €1,199.00 In stock
Raw capture"1.199,00 €"Stored value1199.00 EUR
Run activeOpening the page

Start with the source you actually have

Product pages, result lists and feeds do not behave the same way.

Each source keeps its own navigation, extraction and health logic while producing consistent downstream fields.

01

Single product page

Capture the definitive product state, including variants and fields revealed after interaction.

Detail verification
02

List and category pages

Discover product URLs, work through pagination and preserve the relationship to each listing.

URL reconciliation
03

Search results

Submit a query, wait for the result state and follow matching products into their detail pages.

Search workflow
04

CSV and XML feeds

Map source columns, preview common fields and normalize values through the same validation pipeline.

Mapped import

Browser interactions, made explicit

When a person has to work through the page, the workflow can describe that journey.

Reevals uses the visible controls and states of the configured page: click, fill, scroll, wait, branch and capture. The sequence remains inspectable instead of disappearing inside a black box.

01 / 04

The price appears only after a valid variant is selected.

Discover available colours and sizes, iterate the valid combinations and capture the resulting price and stock state for each one.

  • Discover control options
  • Loop valid combinations
  • Capture the resulting state
store.example / grill
Choose colour
Choose size
Visible result€1,199.00In stock
Sequencediscover → foreach → click → wait → capture5 states

Build the journey from visible actions

Model the browser flow before you trust the extraction.

Combine small, reviewable actions into reusable scenarios. Branch only when the page requires it. Keep the happy path readable.

01⌨Fill inputEnter a query, SKU or postal code
02↗Click or pressUse the visible page control
03◌Wait for stateDOM · URL · network · visibility
04⑂Loop or branchVariants, elements and conditions
05□Capture evidenceFields, URL, HTML or screenshot
Bounded action timeoutsBounded loops and combinationsReviewable branch logicScreenshots available for diagnosis

Raw value to decision-ready field

See the value at every stage—not only after it is wrong.

The common-field preview uses the same normalization path as the stored value. Teams can inspect what was picked, how it was transformed and what will be published downstream.

  • Price and currency normalization
  • Availability and delivery mapping
  • Ratings, identifiers and product attributes
Field previewValidation passed
01 · Picked from page"1.199,00 €"selector: [data-price]
02 · Transformed1199.00parser: decimal_eu
03 · Final stored value1199.00 EURtype: money
Stock availability"In stock" → in_stockValidReview rating"4.8 out of 5" → 4.8ValidShipping price"—" → nullReview

Operational visibility after launch

Know whether the page responded, the workflow finished and the product was really missing.

HTTP response and processing outcome stay separate. A healthy run is confirmed only after the final callback and queue work are complete.

Current run

List · Garden category

Running
✓Crawling24 pages
✓Preparing product URLs186 URLs
Extracting142 / 186
76%
Last successful run 18 minutes agoQueue Healthy
Product lifecycle evidence

Outdoor grill 60 cm

SKU 40218
EvidenceStateObserved
Category listingMissing
Direct product checkHTTP 200
Processing outcomeProduct present
Consecutive misses1 / 3

iA missing listing URL triggers direct detail verification instead of immediately marking the product unavailable.

Collected once. Kept in context.

The workflow does not end at extraction.

Validated fields retain source, freshness and run evidence as they move into the rest of the pricing system.

Collection evidence1199.00 EURProduct present · fresh 12 min
02Product matchingComparable context
03Market monitoringOffer and rank
04Pricing decisionsRules and guardrails
06AnalyticsMeasured outcome

Reliability needs an honest boundary

A durable workflow starts with the source—not with an unlimited promise.

We configure collection around the source structure, permitted access and a responsible cadence. Exact support is assessed against the real page or feed. Run state and limitations remain visible after launch.

  • 01Source access and load constraints are part of the design.
  • 02Failed transformations cannot silently publish a valid-looking value.
  • 03Operational changes remain reviewable and auditable.

Before we map the source

Questions teams ask about collection workflows.

Yes, when the required path can be expressed through supported browser actions such as filling an input, clicking a visible control, scrolling and waiting for a page state. Exact support is confirmed against the configured source.

Start with one real source

Show us the page journey your team handles manually today.

We will map the source, required interactions, fields, validation rules and operational boundary before recommending a workflow.