Build real time Twitter dashboard using Azure LogicApps + Power BI
In this post,we are going to look how to build a real-time PowerBi dashboard using any of trending Twitter hashtags (ex.#Rajinikanth hashtag) here we are going to analyse social media sentiment post Rajini’s political debut, by analysing twitter hastags :) hope you would like it!
Before looking at the steps,here’s summary of what you’ll need.
- Azure account
- Power BI account (you can create it here)
- Cognitive services account (you can create it here)
Step #1 : Create new logic app to listen to twitter hashtags :
Logic Apps provide a way to simplify and implement scalable integrations and workflows in the cloud. It provides a visual designer to model and automate your process as a series of steps known as a workflow. There are many connectors across the cloud and on-premises to quickly integrate across services and protocols. A logic app begins with a trigger and after firing can begin many combinations of actions, conversions, and condition logic.
Logic Apps is a fully managed iPaaS (integration Platform as a Service) allowing developers not to have to worry about building hosting, scalability, availability and management. Logic Apps will scale up automatically to meet demand.
Logic Apps brings speed and scalability into the enterprise integration space. The ease of use of the designer, variety of available triggers and actions, and powerful management tools make centralizing your APIs simpler than ever. As businesses move towards digitalization, Logic Apps allows you to connect legacy and cutting-edge systems together.
Once you login to Azure portal,create a new Logic app like the below :
Create your logic app with the settings like the one below:
When you’re ready, select Pin to dashboard. That way, your logic app automatically appears on your Azure dashboard and opens after deployment. Choose Create.
After Azure deploys your logic app, the Logic Apps Designer opens and shows a page with an introduction video. Under the video, you can find templates for common logic app patterns. We are going to choose ‘When a new tweet is posted’ trigger.
Products from Amazon.in
- -9%
- Social Humour: Adult Card Game, an Unofficial Indian Version of Cards Against Humanity, White Colour
- Price: INR 999.00
- Was: INR 1,100.00
- -24%
- Twitterature: The World’s Greatest Books Retold Through Twitter
- Price: INR 190.00
- Was: INR 250.00
- Hatching Twitter
- Price: Check on Amazon
- Decor Kafe ‘Adorable Twitter Couple’ Wall Sticker (Vinyl, 50.8 cm x 40.64 cm x 2.54 cm)
- Price: INR 299.00
- Social Media: 2017 Marketing Tools for Facebook, Twitter, Linkedin, Youtube, Instagram & Beyond
- Price: INR 434.00
- Twitter and Tear Gas — The Power and Fragility of Networked Protest
- Price: INR 2,219.69
- Building Cloud Apps with Microsoft Azure: Best Practices for DevOps, Data Storage, High Availability, and More (Developer Reference)
- Price: Check on Amazon
- Microsoft Azure Essentials Azure Automation
- Price: Check on Amazon
- -17%
- Azure IoT Development Cookbook
- Price: INR 662.00
- Was: INR 799.00
- -20%
- Architecting Microsoft Azure Solutions
- Price: INR 474.00
- Was: INR 595.00
‹ ›
Every logic app workflow starts with a trigger. The trigger fires when a specific event happens or when new data meets the condition that you set. Each time the trigger fires, the Logic Apps engine creates a logic app instance that starts and runs your workflow.
Now that you have a trigger, add an action that invokes cognitive services to detect the sentiment when a new item appears in the twitter feed. Your workflow performs this action after the trigger fires.
Image — Choose action as ‘Text Analytics’
Image — Choose ‘Detect Sentiment’ among the actions
Step #2 : Create Cognitive Services (API keys for text analytics)
Text Analytics API is a cloud-based service that provides advanced natural language processing over raw text, and includes three main functions: sentiment analysis, key phrase extraction, and language detection.
Sentiment Analysis API returns a sentiment score between 0 and 1 for each document, where 1 is the most positive.Azure models are pretrained using an extensive body of text and natural language technologies from Microsoft. For selected languages, the API can analyze and score any raw text that you provide, directly returning results to the calling application.
What we are going to do is submit data for analysis and handle outputs in our code. Analyzers are consumed as-is, with no additional configuration or customization.We would need to get API key,this key must be passed on each request.
Once you sign up,you would receive API key and REST endpoint.Enter the same,in ‘Detect Sentiment’ step of Logic app.
Once you click on ‘Create’ button.Choose ‘Tweet Text’ to detect sentiment.
Step #3 : Create Power BI streaming data set
With Power BI real-time streaming, you can stream data and update dashboards in real-time. Any visual or dashboard that can be created in Power BI can also be created to display and update real-time data and visuals. The devices and sources of streaming data can be factory sensors, social media sources, service usage metrics, and anything else from which time-sensitive data can be collected or transmitted.
Login to PowerBI and create Streaming dataset (At the top right you can press the plus button to create a new streaming data set.)
Here we would define our streaming dataset, you can define your variable names and types here. I’m going to add 3 variables for now but this can be extended as required. Important point is, make sure you check the ‘Historic data analytics’ slider to On.
Once you click on ‘Create’ button there would be Push URL created for this dataset,we can go back to Logic App & Add a new step and search for ‘Power BI’ then add this step which should look as follows:
Step #4 : Add Power BI action to push the Sentiment analysis data
Step #5 : Design Power BI dashboard
Once you login to Power BI account,locate your data sets and click on the graph icon as shown below.
On the dashboard,I have added graph with the sentiment over time and text box which just displays count of tweets.
Now you can navigate to dashboard and see the counter go up every time a tweet is tweeted!
Here is the final output
I have add some more elements like map etc., & here is the final one.
Like this post? Don’t forget to share it!
Originally published at @upnxtblog.
