As Google Summer of Code 2016 has officially begun, I am all excited to be working with FOSSASIA yet again. This time, I have been assigned the project Loklak where I shall be spending the summer working on implementing indexing (harvester/scrapers) for different services like weibo.com, angel.co, meetup.com, Instagram etc.
Loklak is a server application which is able to collect messages from various sources, including Twitter. This server contains a search index and a peer-to-peer index sharing interface.
If one likes to be anonymous when searching things, want to archive Tweets or messages about specific topics and if you are looking for a tool to create statistics about Tweet topics, then Loklak is the best option to consider.
Spin-Off: Loklak fuels Open Event
Continuing with the Loklak & Open Event Partnership (check out Loklak fuels Open Event ), we can now easily in clicks create our very own web-app for the event with details imported from eventbrite.com powered by Loklak.
The scraping of data done using JSoup, Java HTML parsing was explained in the previous post of this series.
Next, a console service was implemented as the single point for information retrieval from various social networks and websites (a post coming for it soon 😉 ) especially for SUSI (our very own personal digital assistant, a cute one indeed !)
The JSONArray result of the EventBriteCrawler was set in SusiThought, which is nothing but a piece of data that can be remembered. The structure or the thought can be modelled as a table which may be created using the retrieval of information from elsewhere of the current argument.
/** Defining SusiThought as a class
* which extends JSONObject
*/
public class SusiThought extends JSONObject {
/* details coming soon.... */
}
/** Modifications in EventBriteCrawler
* Returning SusiThought instead of
* a simple JSONObject/JSONArray.
*/
public static SusiThought crawlEventBrite(String url) {
...
...
SusiThought json = new SusiThought();
json.setData(jsonArray);
return json;
}
The API EndPoint was thus created.
A sample is as: http://loklak.org/api/console.json?q=SELECT * FROM eventbrite WHERE url=’https://www.eventbrite.fr/e/billets-europeade-2016-concert-de-musique-vocale-25592599153′;
The files generated were next imported in the Open Event Web App generator, using simple steps.
It’s amazing to see how a great visual platform is provided to edit details parsed from the plain JSONObject and deploy the personalized web-app !
Tadaa ! We have our very own event web-app with all the information imported from eventbrite.com in a single (well, very few 😛 ) click (s) !
With this, we conclude the Loklak – Open Event – EventBrite series.
Stay tuned for detailed post on SUSI and Console Services 🙂