I mean... it's just the Rust version of

try {
  AAAAAAAAAAAAAAAAAAAAAAAA
}
catch (err) {}

gives me nightmares

this database pool connection system is intended for the endpoints

possible things to look into:

• diesel r2d2 docs

When searching for a product in Blibli or Bukalapak, products wouldn't automatically load in, but a loading spinner would appear instead. It would be nice for the scraper to wait until the products actually load in. Maybe replace it with a web driver?

As of now, the only available scraper is Tokopedia. It would be cool to have scrapers for other sites, accomplishing the whole objective of this project.

• Bukalapak
• BliBli
• Shopee
• Lazada

For example, when retrieving the price of a product in Tokopedia, the only text node may be "Rp130". But the actual text displayed in the price element is "Rp130.000".

Upon entering Tokopedia, the scraper would get all the products available in the DOM. But all the rest of the products in the page aren't loaded in yet. And for them to be loaded, they need to be visible within the viewport (scrolling down to load them in).