f‎ > ‎q‎ > ‎

j

Enterprise Twitter
  • UK and France to jointly pressure tech firms over extremist content

    UK and France to jointly pressure tech firms over extremist content

  • Organizing your marketing tech stack

    Organizing your marketing tech stack

  • We want to limit use of e2e encryption, confirms UK minister

    We want to limit use of e2e encryption, confirms UK minister

  • Browse more...

firehose
  • Gnip Launches Full-Archive Search API To Provide Instant Access To Nine Years Worth Of Tweets

    Gnip Launches Full-Archive Search API To Provide Instant Access To Nine Years Worth Of Tweets

  • Gillmor Gang: Action Items

    Gillmor Gang: Action Items

  • DataSift Launches Vedo To Help Enterprises Channel The Big Social Data Firehose

    DataSift Launches Vedo To Help Enterprises Channel The Big Social Data Firehose

  • Browse more...

ntt data
  • NTT Data announces strategic investment in NoSQL database provider MarkLogic

    NTT Data announces strategic investment in NoSQL database provider MarkLogic

  • NTT to buy Dell’s services division for $3.05 billion

    NTT to buy Dell’s services division for $3.05 billion

  • Dell reportedly near closing the sale of its IT services unit to Japan’s NTT Data

    Dell reportedly near closing the sale of its IT services unit to Japan’s NTT Data

  • Browse more...

datasift
  • DataSift connects with LinkedIn as its latest social marketing partner

    DataSift connects with LinkedIn as its latest social marketing partner

  • Nick Halstead, Founder Of Big Data Analytics Firm DataSift, Steps Down As CEO

    Nick Halstead, Founder Of Big Data Analytics Firm DataSift, Steps Down As CEO

  • Datasift Expands Its Reach With New Pulsar Deal To Make Facebook Topic Data Bigger

    Datasift Expands Its Reach With New Pulsar Deal To Make Facebook Topic Data Bigger

  • Browse more...

Twitter Cuts Off DataSift To Step Up Its Own Big Data Business

Posted Apr 11, 2015 by Ingrid Lunden (@ingridlunden)
  • 0

    SHARES
Next Story

A New Revolution Modernizes The Revenue Supply Chain

In the push for more revenue growth, Twitter has been building up its business in areas like advertising and commerce, but a move made late Friday night points to another area where the company is setting its sights: big data analytics.

Twitter announced that it will be terminating agreements with third parties for reselling firehose data — the unfiltered, full stream of Tweets and all related metadata that goes along with them.

Instead, it will use its own in-house big data analytics team, which it developed around its acquisition of Gnip in 2014, to seek to build direct relationships with the data companies, brands and others that use Twitter data to measure consumer sentiment, market trends and other moving targets that can be better understood by tracking online conversations — a transition it says it hopes to have completed by mid-August.

DataSift, the biggest company to be affected by Twitter’s move, services thousands of businesses who in turn serve thousands more. Unsurprisingly it moved quickly to post its own reaction to the termination and its own determination to push ahead in its own business.

NTT Data, which deals only in Japanese Tweets, is still listed as a Twitter firehose partner at the time of writing, but Twitter has confirmed to me that NTT is also affected by Friday’s announcement.

This is both a very unsurprising and sudden move, from the looks of it.

Talking to Nick Halstead, the CEO and founder of DataSift, he said that his company was “blindsided” by Twitter’s announcement, which it made without any warning to DataSift. He said that before this, the pair had been discussing a renewal of the deal. And while DataSift recently added Facebook — Twitter’s big social advertising competitor — as a firehose partner, it didn’t appear that this would impact those discussions.

“We were in the middle of negotiations with everything pointing to Twitter wanting to still continue to be a part of an open ecosystem,” he said, “but this is clearly now not true.”

On the other hand, for those who have been following how Twitter has grown as a business, the company’s move to cut off third-party firehose relationships should come as no surprise.

The company has made no secret of its bigger philosophy about how it interfaces with third parties in general. In its (in)famous ‘quadrant’ diagram, the company outlined its position towards third parties that added value to what Twitter was doing versus those that effectively overlapped with Twitter’s own efforts: those who were building Twitter clients that “mimic” Twitter’s own experience in reproducing the Twitter stream were getting cut off.

You can think of last year’s move by Twitter to acquire Gnip — another firehose reseller who competed with DataSift — as a step Twitter was taking to move its interests into one more area of that quadrant.

At the time the acquisition was seen mainly as a response to Apple’s acquisition of Topsy, who had been another firehose partner. And DataSift went so far as to reassure people that its status with Twitter would not be affected. But now it’s clear that Twitter had other things in mind, too.

Zach Hofter-Shall, head of Twitter ecosystem, said as much in his blog post late Friday:

“One of the reasons Twitter acquired Gnip was because Twitter believes the best way to support the distribution of Twitter data is to have direct data relationships with its data customers – the companies building analytic solutions using Twitter’s data and platform,” he wrote. “Direct relationships help Twitter develop a deeper understanding of customer needs, get direct feedback for the product roadmap, and work more closely with data customers to enable the best possible solutions for the brands that rely on Twitter data to make better decisions…The acquisition of Gnip was the first step toward developing more direct relationships with data customers.”

In fact, whether they wanted to believe it or not, these companies were told by Twitter that they would be getting cut off nearly a year ago, we understand.

The direct relationships Twitter has with data customers, meanwhile, are also starting to take a new kind of form. Just last month, Twitter made its first investment in a startup through its new investment vehicle. The recipient? Dataminr, one of the companies that analyses Twitter firehose data, in its case to track news and financial data.

The reason why Twitter wants to tap into more big data business, of course, comes down to one big reason: money.

Since going public, Twitter has regularly faced questions about user growth. On one hand, that has led it to many iterations as it tries to snag more consumers who are not already regular Twitter users. On the other, it has increasingly focused on ways that it can better monetise what it already has.

That’s where the big-data services come in. Twitter’s data firehose, from what we understand, makes up a relatively small portion of DataSift’s revenues. The company makes 20% of its revenues from licensing data, with that data including Twitter but also more than 20 other networks. The remaining 80% comes from data processing.* Cutting off the firehose to DataSift, Twitter hopes, will potentially give it access to (and better returns on) the customer deals that DataSift held before.

(The big question now will be whether Twitter manages to convince enough of the people who used to buy data through DataSift to turn directly to Twitter for those needs instead.)

“Twitter believes that creating a closed market for their data allows them to generate more revenue,” Halstead told TechCrunch. “We believe and others believe that an open ecosystem is important for a brand to understand what is going on in the market.”

As for where DataSift is turning next, the company says it is signing on more social networks to provide its own firehose data feeds. No comment from DataSift on which feed will be next, but it’s notable LinkedIn is not yet a partner. The social network for the working world is clearly looking for more ways of using its data for analytics, and this seems an obvious route to do that.

DataSift is also still able to work with Twitter data: if a third party buys data from Twitter, it can supply it to DataSift by way of a “connector” so that it can still be parsed by DataSift’s algorithms. However, this will mean significantly lower revenues for DataSift in the process from that feed. And  armed with its Facebook deal and other developments in the pipeline, DataSift is pressing ahead with business. The company is currently in the process of raising a new round of funding — a Series D round. To date, DataSift has raised nearly $78 million.

Update: Mark Suster writes that DataSift returns 95% of data revenue back to Twitter. The 20/80 ratio we were describing referred to revenues from data firehose licensing versus data processing revenues for DataSift. We’ve updated the passage above to clarify this.

Featured Image: Bryce Durbin
  • 0

    SHARES
Advertisement Advertisement

Crunchbase

  • DataSift

    • Founded 2010
    • Overview DataSift is the leader in Human Data Intelligence. DataSift enables organizations to identify and extract valuable insights from all types of human-generated data in real-time. They’ve built a powerful engine for programmatically understanding and analyzing what is being said across social networks, blogs, news sites, and inside businesses, while protecting consumers’ privacy. Founded in 2010, …
    • Location San Francisco, CA
    • Categories Cloud Computing, Analytics, Big Data
    • Website http://www.datasift.com
    • Full profile for DataSift
  • Life On Air, Inc

    • Founded 2012
    • Overview Life On Air's mission is to connect people in the most human way possible while physically apart. Our latest product, Houseparty, it the best manifestation of that vision thus far. Houseparty is currently available for for iPhone and Android (beta). Previous products by our team: Meerkat (tweet live video), Air and Yevvo.
    • Location San Francisco, California
    • Website http://lifeonair.com
    • Full profile for Life On Air, Inc
  • NTT Data

    • Founded 1967
    • Overview NTT DATA provides broad range of IT services and solutions, including consulting, systems integration and IT outsourcing, for major financial, public administration and enterprise sectors. NTT DATA Group has established global support network that covers 65 cities in 21 countries worldwide (as of October 2008).
    • Location Tokyo, 40
    • Categories Software, Information Technology, Information Services
    • Founders Harsha Rajasimha
    • Website http://www.nttdata.com/
    • Full profile for NTT Data
  • Periscope Co

    • Founded 2014
    • Overview Periscope lets you see the world in real time through someone else's eyes. Where would you explore, if you could teleport somewhere and be in somebody else's shoes? You'll be able to learn more about Periscope later this year. Please reach out to us if you're interested in joining the team!
    • Location Minneapolis, MN
    • Categories Real Time, Apps, Video Streaming
    • Founders Kayvon Beykpour, Joseph Bernstein
    • Website http://periscope.tv
    • Full profile for Periscope Co
  • Twitter

    • Founded 2006
    • Overview Twitter is a global social networking platform that allows its users to send and read 140-character messages known as “tweets”. It enables registered users to read and post their tweets through the web, short message service (SMS), and mobile applications. As a global real-time communications platform, Twitter has more than 400 million monthly visitors and 255 million monthly active users around …
    • Location San Francisco, CA
    • Categories SMS, Blogging Platforms, Social Media, Messaging
    • Website http://www.twitter.com/
    • Full profile for Twitter

Newsletter Subscriptions

Latest Crunch Report

  • Microsoft Reveals The Xbox One X | Crunch Report

    Microsoft Reveals The Xbox One X | Crunch Report

Watch More Episodes
  • firehose
  • ntt data
  • Twitter
  • datasift
  • Enterprise
  • Popular Posts

    #auto

    Subpages (1): f
    Comments