Case Study: Sentiment Analysis by Lingway

Sentiment analysis is in big demand these days. Lingway uses natural language processing (NLP) to understand how people feel about various brands. Lingway specializes in processing text data, but they rely on the specialty of 80legs to gather that data from the Web.
Here's how Lingway's workflow handles data extraction and collection:
- Search engines are used to generate a list of URLs related to given keywords about a brand.
- The URL list is uploaded to 80legs as a seed list, and a web crawl is started from this seed list.
- During the web crawl, a custom data extractor (aka "80app") is used to process and cleanup the text content of a web page.
- The results generated by the 80legs web crawl are then fed into Lingway's NLP tools, which determine sentiment.
The 80legs API and 80app framework, along with the raw bandwidth and web crawling speed provided by 80legs, lets Lingway crawl the web in a very short time for any given topic. 80legs helps Lingway with massive distributed data cleanup and enhances the performance of its own product.
