Browse > Home / Archive by category 'Realtime'

| Subscribe via RSS

Top five advanced research tools for Twitter

May 9th, 2011 | No Comments | Posted by Colin Meek in Advanced Techniques, Monitoring Tools, Realtime

By Colin Meek (@colinmeek) and Judith Townend (@JTownend)

In our recent three part series we tested the best tools for researching Twitter. If you are engaged in serious research on topical issues you can’t ignore Twitter. And, if you can’t ignore Twitter, then you need to grasp the best ways to tap the resource. Of all the techniques we tried out, these are the ones we rated as our top five:

1. It’s an obvious one, but TweetDeck really is indispensable for us. Not only does it help manage conversations, the powerful Twitter monitoring desktop client allows you to monitor multiple topics, keywords, lists, people or hashtags in columns.

2. Twiangulate provides a very intuitive way of analysing networks and connections.

3. It has its flaws, but Twitter Search ranks pretty highly for us – especially once you’ve got your head around the various advanced operators.

4. Listorious, with a database of more than 2 million Twitter users allows you to search for  Twitter users by topic, keyword or Twitter lists.

5. Tweetscan is a simple, but sensible way to back up your tweets for offline use. It doesn’t catch them all – your last 1,000 messages – but it then combines them with results from its index, going back to 2007.

  • In part one of our Advanced Twitter research series we looked at Twitter search: read at this link.
  • In part two we examined the best ways of finding people to follow: read at this link.
  • In part two we  showed you the best ways to track hashtags and archive your tweets: read at this link.

** Learn more about sophisticated search techniques on our one-day Advanced Internet Research course, Tuesday 5 July in London.**

Tags: , , , , , ,

Twitter advanced research techniques 3: tracking #hashtags and archiving tweets

April 26th, 2011 | 4 Comments | Posted by Colin Meek in Realtime, Search tools and tricks, Social Networks

By Colin Meek (@colinmeek) and Judith Townend (@JTownend)

Our third post in the Insite series on Twitter research looks at how to follow Twitter trends marked with #hashtags. If you’re reading this you have probably already clocked how useful #hashtags are, allowing you to isolate specific topics on Twitter.

This is how Twitter defines them:

The # symbol, called a hashtag, is used to mark keywords or topics in a Tweet. It was created organically by Twitter users as a way to categorise messages.

Sometimes they’re using #inajokingmanner to no real purpose, but most of the time they allow you to follow a category of Tweets more easily – about a news story, or an event, for example. The most popular #hashtagged topics will appear in your Twitter sidebar as trending topics (advertisers can pay for their ‘promoted’ topic to trend at the top).

Hashtags are effective advertising and marketing tools, as well as useful aids to follow conversation, live events and breaking news.

This article on Twitter media examines what makes a hashtag popular. Maybe no surprises to learn that in the main it’s repetition, repetition, repetition. “You need to see a hashtag four or five times before it really clicks,” says the report but not too much: there’s a “sweet spot” after just a few.

For a bit of Twitter history, have a look at the first ever hashtag on Twitter. The ReadWriteWeb reported that according to serial social technology innovator Chris Messina it was #barcamp. It’s logical that a tweet about a technology meetup would be the first topic on Twitter, before it got taken over by the journalists, the spammers and the celebrities.

Tools for tracking hashtags

1. TweetDeck: is a simple, intuitive and immensely powerful Twitter monitoring desktop client that you can download for free. Many, many people admit to ‘not getting’ Twitter until they use TweetDeck. The beauty with TweetDeck is that you can monitor various topics, keywords, lists, people or hashtags in columns. New posts slot in at the top of the columns to create a cascade of posts on your topic. Here TweetDeck is monitoring the Scottish election hashtag #SP11, posts on Syria using #syria and the journalism.co.uk user news feed:

2. Hashtags.org: This site allows a simple tag search, showing you trends and recent tweets on topics. Or go directly to trendistic.com, which supplies the graphs.

3. Twitseek shows you the trending topics of the day, split into different sectors: celebrities, sport, news, stories, people (although topics could fall into more than one category on that list) and includes the URL of the tweets.

Finding old trends & archiving tweets

One problem with Twitter search is that tweets drop out in time – as you’ll see if you go to look for one of your past tweets.

Tweetscan claims to query both Twitter and its own index going back to December 2007 to provide, what it says (it would!) “the most complete and convenient backup available”.

It also allows you to backup your Twitter account if you give it access to your account, a very handy tool, if you have comments and @replies you wish to use in the future, for research or commercial purposes.

“Your last 1000 messages are downloaded from Twitter and combined with results from our historical database. Tweet Scan can retain your tweets to improve later backups.”

Tweetscan also allows offline search and storage.

Alternatives to Twitter Search

Dave Larson has an excellent list of Twitter search engines here, which includes: Searchtastic;SnapBirdTwimeMachine (browse up to 3200 of a user’s old tweets); Topsy; The Archivist (Windows only or browser version); TweetBoard (private alpha); BackTweets (subscription required for full access); FriendFeed; and http://research.ly/ (subscription required, from $9-$99).

Topsy is particularly handy because it notifies bloggers when someone has tweeted their story, via a pingback. But it’s Searchtastic and SnapBird that Larson considers the best for your “Twitter arsenal”.  Searchtastic has one particularly useful feature: you can back up tweets and export to a spreadsheet.

Read Larson’s post in full for a more detailed explanation of each engine and see his chart comparing their functionality here. And if you’re still thirsty for more, Larson has listed 30 more Twitter search options at this link. Enjoy!

  • In part one of our Advanced Twitter research series we looked at Twitter search: read at this link.
  • In part two we examined the best ways of finding people to follow: read at this link.

** Learn more about sophisticated search techniques on our one-day Advanced Internet Research course, Tuesday 5 July in London.**

Tags: , , , , ,

Twitter advanced research techniques 2: finding the right people

March 4th, 2011 | 1 Comment | Posted by Colin Meek in Advanced Techniques, People, Realtime, Search tools and tricks

By Colin Meek (@colinmeek) and Judith Townend (@JTownend)

This second post in our series on Twitter research tackles tools and tips for finding the right people and networks. We also look at some of the most high profile Twitter services that offer search services and other functionality. But, first a word of warning. New Twitter tools are popping up all the time. This a fast changing area and new services can be abandoned by developers. Don’t rely on one tool and keep an eye out for alternatives as they come along.  Additionally, don’t forget Twitter’s own tools, which are frequently updated.

Simple Twitter User Finder

For simple topic searches Listorious is a good start. It has a database of more than 2 million Twitter users and you can search for  Twitter users by topic keyword or Twitter lists. Here we used the search phrase ‘oil spill’.

Network research and analysis

To tap the real potential of Twitter, however, you need to make connections between people. This is important for many reasons: to profile people accurately; to discover new contacts; to make unexpected connections between individuals and groups; and, to identify influential people within networks.

One of the best and most intuitive tools to help you with this Twiangulate and here’s how you can use it to analyse networks and connections.

Firstly, you can map connections to create a useful visual network of Twitter users. You can either identify a specific Twitter list or you can add as many Twitter users as you like.

Twiangulate then automatically creates a ‘map’ of the network and how they connect to each other. In this example we ‘mapped’ a list of Twitter users related to the Gulf oil spill.

Each user in the network is identified on the map and the value allocated to each member indicates the percentage of other members they are linked to. When you hover your cursor over individuals in the map you pull up profile information for that member including recent tweets and bio information. For a quick and visual way to get to grips with a specific network this tool is excellent.

Twiangulate also gives you the power to look at a Twitter user’s ‘inner circle’. There is nothing interesting about whether someone follows Stephen Fry. The Twitter contacts that are far more interesting are the users who have a more modest following. These people are more likely to have firmer connections to the user you want to profile. Twiangulate calls this their ‘under-the-radar’ service because it serves up the 100 friends with the fewest connections followed by specific users. Those Twitter contacts are more likely to be close colleagues, friends or business associates.

In this example we have looked at two high-profile BBC journalists. In addition to this visual, Twiangulate lists their 100 friends with the fewest contacts. It also highlights those common to both.

Another way to find connections is to trace mutual friends – the people who two or three Twitter users follow in common. Use this to get to the  heart of particular networks and identify influential people in groups. In this example (below) we looked for people followed in common by two BBC journalists and the science writer Ben Goldacre. We found that one user is followed by all three while at least two of the users we included in our analysis share hundreds of friends. The more the friend lists overlap – the closer you are to the heart of a network.

Another way to analyse networks is to find mutual followers – who follow the same two, three or four people. These people have made common ‘follow decisions’ which suggests they have a well-defined focus of interest. In this example we selected three journalists and commentators on video gaming and games development.

We found that 86 Twitter users follow all three of these people. Obviously, if you identify three important resources on Twitter then people who follow all three may also be important targets for your research. Hence: ‘twiangulate’.

Tools to help you find tweeps

LocaFollow: A fairly high-profile service promising to help you find local Twitter users in small towns, using Google search. The immediate thing to be aware of with this tool, as with many others, is that you need to give it access to your Twitter account for full functionality. Users are increasingly becoming more aware of security issues associated with third party access, so think carefully about which services you use.

So, what does LocaFollow do? The service aims to help you search for Twitter handles with certain characteristics, eg. location, keyword in bio and then follow them from that page.

However, the site seems to have reached a hiatus. The last blog update was in July 2010.

The problem here is that you can do your own advanced keyword searching to identify the right people without LocaFollow. If you are familiar with Google’s advanced operators you can search for keywords in Twitter bios and specific locations. For example this search: site:twitter.com bio * doctor (the operators are in red) typed directly into Google’s search field returns hundreds of thousands of Twitter users with the word ‘doctor’ in their bios.

This similar search: site:twitter.com location * edinburghfinds people who specify their location as Edinburgh. For serious research, other tools do a better job than LocaFollow.

Tweet Adder is another high profile Twitter tool which is advertised at the bottom of the LocaFollow page and you have to pay for everything other than the free demo.

And, again, for functionality you’ll have to give it access to your Twitter account.

We tried the free demo. It’s pretty nice. It allows you to search Twitter users by various factors: eg. topic/location and brings up a list which you can check and create lists from. You can then ‘follow’ by bulk. There’s also an option to search profile data and the followers of users and lists.

The ‘tweet generator’ tool, however, probably isn’t going to pass muster for a journalist. There’s some things that should be done by a human. Plus, we couldn’t actually get it to work in the demo. The feature for tweeting from an RSS feed is likely to be more appropriate for journalists and researchers.

Overall, Tweet Adder is much more intuitive than LocaFollow.  But its primary role is not research. Instead, it is designed to help you get followers. Whether it’s worth the money to a researcher or journalist is the key question, especially when there are so many excellent free tools available.

Other tools

Twitscoop offers a range of services such as tag and trend monitoring in real-time. Like Tweet Adder, it also offers tools to monitor your follower activity, once it has access to your account. Here we have logged in with an account:

It shows trending topics, as well stats for certain tweets. In the example above, it showed us that @bengoldacre’s link had received 872 clicks. It uses Zobmark to archive and organise your Twitter links – this is a service that collects your links when you tweet #zob with your message.

However, when we tried out Zob, our tweets didn’t show up and it doesn’t look like it has a very big user base. Plus, Zobmark’s own bookmarks haven’t been updated since 27 January.

With bookmarking tools like Delicious and Diigo for storing tweets and services like FriendFeed that capture your tweets, the benefits of this service aren’t really obvious – plus you have to stick an odd looking hashtag on all your content.

Moving onto the next, Twitstat. To have any functionality at all with Twitstat you need to be logged in. Once in, it’s pretty ugly.

Looks aside, it lets you search a Twitter user, establish your relationship and view lists and see your retweets (by you, and your tweets retweeted) from your home page. Not much you couldn’t do on the Twitter page.  Plus, Twitter is prettier.

Tweet Adder, LocaTweet, Twitscoop and Twitstat are better as marketing rather than tools for serious or effective research. For the latter, we need to look elsewhere.

In our next post in this series we’ll examine #Hashtags and Trend Monitoring.

** Learn more about sophisticated search techniques on our one-day Advanced Internet Research course, Wednesday 16 March in London. Book soon though as only two places available at the time of writing. **

 

Tags: , , , , , , , ,

Four #real-time search options leave Google behind

June 21st, 2009 | No Comments | Posted by Colin Meek in Featured, Realtime, Search tools and tricks

While there is no sign of panic yet, there is certainly evidence that established web giants such as Google and Facebook are frantically playing catch-up as the clamour for real-time search grows. Not only are there a range of tools to monitor Twitter in real-time there are browser add-ons that enable you to add Twitter search results to your Google results page. Why is Google being so slow to grasp the demand for real-time search?
The bottom line for journalists is that Google no longer has the best answer to the simplest question: ‘What are people saying about [my query] right now?’ For those of us steeped in Google search experience – it’s a scarey thought. Google is, apparently, working on a real-time offering but, in the meantime, are there competitors to the real-time results available from Twitter and the various Twitter monitoring tools available?
Here’s a heads up on four tools that don’t rely exclusively on Twitter and offer real-time monitoring for your search queries.

collecta1 Collecta, just a few hours old, has the cleanest and most intuitive search page. Your search term is tracked and results listed in a central column. Clicking on those results gives you fuller content and a link to the source. The left hand column lists your recent queries and gives you the chance to include blogs, blog comments, images and updates (tweets) in your results. Collecta also tracks the time since your query. I’ve had impressive results so far.

2 Scoopler, has another crystal clear search page with the main section split between ‘real-time’ search results and ‘popular’ results that include content from news sites and videos. The ‘real-time’ results are drawn from Twitter, Digg, Delicious and other networking sites. This middle column gives you the options of previewing the posts or you can click through directly to Twitter profiles.

oneriot-logo13 OneRiot, claims to do the same as Scoopler and Collecta but when I tried its ‘realtime’ search for results containing ‘tehran’ and ‘iran’ there weren’t a convincing number and they failed to appear with anything like the frequency I would have predicted. On the plus side, you can use its ‘pulse’ search option which uses an algorithm that looks at dozens of factors to give “weight” to certain results. OneRiot has used various factors to influence the weighting including: freshness; source credibility; and, ‘acceleration’ whereby posts that are gaining momentum (links) on the web are ranked as more important.

4 I looked at Icerocket in January. Not only has it set its blog search as its default option, it has also added a twitter search and a real-time ‘Big Buzz’ alternative. Big Buzz pulls in very recent results from blogs, Twitter, Video, News and Images and gives you an ‘auto refresh’ option to update those results every minute or so as you are working on a story.

I am @colinmeek on Twitter

Tags: , , , , , , , , , , , , , , , , , , ,