Work CASE STUDY SwipeNews

CASE STUDY SwipeNews

Analyzer
Feed
News aggregation
News filtering
Parser
Source
SwipeNews

SwipeNews (http://swipenews.com/) is reinventing the news aggregation model to bring you a wide range of angles to the most relevant stories. With help of SwipeNews, you can:

  • discover the key stories covered by multiple media outlets
  • compare coverage across a wide spectrum of media
  • make your own mind up on key events

Testimonials

Sloboda Studio helped with every step of the project, from helping to define the scope and setting out the idea to execution and project management. I was very satisfied with the team's attitude and the result given the limited budget. Great communication and ownership throughout the project.

Our goal

For this project, on our part, we have developed a holistic solution to the logic of data processing.

Challenges and solutions

Parser

There are sources, each source has own feeds, for each feed and source, the status of the feed and the source as a whole is displayed with the status display.

Feeds are divided into topics for the purpose of submitting news filtering.

24 sources of 86 feeds (RSS feeds).

 

Analyzer

The log-in news is downloaded in full (Title, Short description, Full text), cleaned of debris (stop words, punctuation marks, decreased to normal form). A statistical evaluation and selection of simple (from one word) and complex trends (and several) are carried out.

Making a record of similarity between news, with the formation of a coefficient of similarity based on Key words, Abbreviations, Trends, Complex Trends. Trend Abbreviations.

Clustering. Dynamic clustering with the ability to view a more general structure. (Modified for the needs of this service Single Link clusterizer).

The system settings include the weight of various coefficients.

Technologies

Server-side

PostgreSQL
Rails
Ruby
Sidekiq