Meet the largest database of human knowledge ever created: Diffbot Knowledge Graph Diffbot is pleased to announce the launch of a new product: Diffbot Knowledge Graph. What is the Knowledge Graph? Eight years ago, Diffbot revolutionized web data extraction with AI data extractors (AI:X). Now, Diffbot is set to disrupt how businesses interact with data from the web again […]
The Ultimate Guide to Product and Pricing Data
Today there are more products being sold online that there are humans on earth by a factor 100 times. Amazon alone has more than 400,000 product pages, each with multiple variations such as size, color, and shape — each with its own price, reviews, descriptions, and a host of other data points. Imagine If you […]
What is Product Data?
Every now and then it’s important to get back to basics and ask a question which seems obvious, because sometimes those questions have hidden depths. The question “What Is Product Data?” is one of those I recently asked myself, and it led me down a mini-rabbit hole. The basic definition of a product is: “A […]
Why You Need to Crawl Your Own Site
You use web crawling for almost every site on the web. Here’s why that list should include your own site, too.
How Certain Site Designs Mess With Data Extraction
Here’s why certain website designs can break a homegrown scraper (and what to do about it).
Why Is Getting Clean Article and Product Data So Damn Hard?
Getting clean article and product data using homegrown web scrapers is difficult. Here’s why…