Posts Tagged ‘research’
« Older EntriesCan we calculate party affiliation? (the US Congress Edition)
Friday, February 13th, 2009
Using nothing more than their public twitter relationships, is it possible to predict whether a US Congressperson is a Republican or a Democrat? The answer seems to be a guarded “yes” — our tools predict correctly 40/46 times (or around 87% of the cases.)
This post follows on from a post earlier today in which I asked, “can we calculate party affiliation?” The data set in the earlier post was gathered from the 16 members of the UK parliament who are on Twitter and the relationships between them.
Tweetcongress maintains a list of US congresspeople on Twitter. Today (February 13, 2009) there are 76 congresspeople on the service, but when I collected my data set of “who follows who” on February 3, 2009 there were only 65. Of these 65, fully 19 (29%) lived a life of noble isolation with regards the network — none of their peers linked to them, and they in turn linked to none of their peers. Removing these Miss Havishams from the data set leaves me with 46 twittering congresspeople who form a network.
Now as both social network analysis and Aesop would have it, “a man is known by the company he keeps.” What I mean by this is that given the partisan nature of politics, we should expect that Democrats will link to other Democrat twitterers more often than they link to Republican twitterers and vice versa. So that’s what NetDraw[1] , the software I’m using for most of this stuff, looks for, or more accurately:
To identify factions, NetDraw software iteratively searches for a distribution of nodes among a selected number of factions to minimise the number of connections between factions and to maximize the number of connections within factions.
Whatever. So I let NetDraw loose on the data, and here’s what it did.
I coloured the nodes red for Republican and blue for Democrats[2], labeled the nodes by party (for the sake of clarity, and for the hard-of-thinking, that’s “R” for Republican and “D” for Democrat) then counted all the nodes where label said one thing but colour another. There were six of these nodes; so NetDraw got the answer right 40⁄46 of the time (just about 87%.) This is less than the astonishing 93.75% accuracy we got with the Westminster twittering members of parliament in the previous post. Nevertheless I think we can safely say that it’s not a particularly integrated (or bipartisan) network if we can predict party affiliation with quite such success.
Here’s exactly the same map with the errant sheep re-labeled with their proper names so it’ll be easier to refer to them (if it helps, you can click on the image to view or download a larger version.)
You’ll see, I hope, that NetDraw has made a pretty good fist of the job. Where it has gone wrong on the whole is where the data clearly suggests something else. So Rep. Jared Polis for instance follows (and is followed by) no Democrat peers. Rep. Nancy Pelosi (D) and Sen. Richard Durbin (D) follow each other, but since Pelosi is followed by several Republicans and none of her other Democrat peers you can see why the algorithm has made the incorrect guess that the two of them are Republicans. Long-serving member Neil Abercrombie, as discussed in a previous post on US Congress Twitter folk, forms a bit of a bridge between the two parties, so despite his membership of the Congressional Progressive Caucus and liberal voting record, from the Twitter network point of view, his affiliation is somewhat ambiguous.
Sen. McCain follows none of his peers, and appears to inherit his incorrect attribution from Sen. Susan Collins. For the life of me, I can’t work out what makes it think that Sen. Susan Collins is a Democrat. She really isn’t, you know.
Note 1: NetDraw is a free program written by Steve Borgatti from the University of Kentucky. If you’re interested in playing around with this stuff, you’ll need to get yourself a copy.
Note 2: Actually, that’s not true. Despite a friend sharing the simple mnemonic that “‘Republicans’ and ‘red’ begin with the same letter,” I just can’t get it out of my English head that the Republicans should be blue and the Democrats red. As a result I waste precious minutes re-colouring these maps in Illustrator. It is worth pointing out that I also have problems with “left” and “right” on occasion — preferring instead the binary opposition “left” and “No! no! The other left, for God’s sake!”
Tags: congress, democrat, gop, jared polis, john mccain, mapping, nancy pelosi, Neil Abercrombie, network analysis, networks, republican, research, richard durbin, susan collins, twitter
Posted in networks, research, twitter | 1 Comment »
Creating blog seed lists for research
Tuesday, February 10th, 2009
Colleagues and regular readers will know that we’ve been working on an “online influencer mapping” tool called Rufus. Those of you who’ve had a chance to use Rufus will know that it requires a seed list of URLs to get started. Creating this seed list can be automated in one or two ways, but one of the fastest, most effective, and most sensible ways to build a seed list is still to do it by hand.
We’ve got one or two other processes that also require us to build a seed list. No doubt other people do too — lots of web research is quite data hungry. So — because I’ve found myself telling a few of my Porter Novelli colleagues how we go about the process, I thought I’d share it here, in the interests of:
- having somewhere to point people in future,
- general good-heartedness: I’ve learned a lot from people in the past, and I like to give stuff back, and
- getting feedback and tips from people about how they might go about the same process.
Oh – and while these methods should work in any language, please bear in mind that I tend to think and work in English. I’d appreciate feedback on how best to localize these methods.
Building a seed list: 5 easy methods
With all these methods, there’s no substitute for checking out the blog. I don’t ask people to read the blog (that comes at a different stage of the process altogether) but you should at least click through and see what you’re dealing with. In fact, method 3 rather relies on you visiting the blogs you’re researching.
1. Look for someone who has already done your research for you
Start by being optimistic. Generally you’ll find that someone else has created a list of the “top ten” (or however many) blogs in the niche that interests you. Take a look at Brendan’s regularly updated PR Friendly Index for example. If you’re searching for English language blogs then you could do worse than start by looking at Guy Kawasaki’s Alltop. But simply Googling for lists of blogs or blog charts should get you a long way.
This is generally a source of fairly high-quality data. One thing to watch out for, though, are search engine spamming link farms, and shady “Make Money Online” (MMO) directories. You’ll learn to recognize these soon enough, but as long as you’re visiting all the blogs you’re putting on your seed list you should be alright.
2. Do a tag search on delicious
I picked up this technique from Anthony Mayfield, who showed me that by searching on the delicious social bookmarking site for the tags “xxx” and “cool” and/or “inspiration” you could find sites about “xxx” that people thought were cool. Knowing what your digital trendsetters think is cool is one hell of an insight.
For our purposes though, we’re looking for cool blogs. So (1) click the “Explore Tags” tab on the home page, and then (2) type your keyword and the word “blog” into the search box. Couldn’t be simpler?
Well — actually it could be simpler. You can query the delicious database when you type the URL into the address bar of your browser like this:
http://delicious.com/tag/blog+keyword
Where “keyword” is the word you’re looking for.
When you get the results, check the ones that (a) have the right kind of title (if you’re looking for French blogs, look for French titles for example), (b) have the right kind of tags and description and (c) have been bookmarked most often
If there’s a better local language social bookmarking site, I’d use that whenever possible. For example, Mister Wong is a good one for German language sites.
A quick note: social news sites like Digg and Reddit, and “serendipity browsers” like StumbleUpon tend not to work so well in my experience.
This method also owes a lot to Marshall Kirkpatrick. You might like to try out the Yahoo! Pipe that I built based on the process that Marshall documents.
3. Look for blog rolls
On every blog you visit during the research process, look for the blog roll — and check the likely-looking links. See if they’re useful or useless. Quite often you’ll find that someone who has an interest in widgets will also read and link to blogs that cover widgets. That, after all, is the principle on which Rufus works wrote small. So we reckon it’s a pretty good approach.
4. Ask your Twitter followers
Seriously — this works. Well — it worked for me and my team from around +100 followers onwards. I’d be interested in others’ experience.
5. Call someone
Get hold of someone who knows about the subject and phone them up or get them on IM. Category experts are an excellent source of low-volume but high-quality information. It’s time consuming, but can work well if you have the right contacts. Journalist friends might be a great source of blog lists.
I’ve purposefully left this one till last; I think it’s a good rule of thumb to do your desk research before picking up the phone. That way you can ask intelligent questions instead of damn fool ones.
Using a text editor
I try to keep two lists running all the time that I’m working; a scratchpad list of blogs I have yet to visit and the seed list itself. Because I’m on a Mac, I use the excellent BBEdit (there’s a free version called TextWrangler which will be just as good for most people.) If — as is more probable — you’re on a Windows machine, you might like to try the very powerful but slightly less pretty Notepad++. But if you just want to use Excel, though, that’s fine, too.
Tags: bbedit, bloggers, blogs, delicious, digg, notepad++, reddit, research, seed list, textwrangler
Posted in research | 4 Comments »
Blogger typology: using IBM’s Many Eyes to build matrix charts
Tuesday, January 6th, 2009
Thanks to IBM’s Many Eyes service it’s relatively simple to create complicated visualizations that my current version of Excel can’t handle. For example, this “matrix chart” that I built using Excel’s bubble chart function is clearly unacceptable. I can’t easily link statements or values to the X and Y axes, and there’s lots of overlapping that seems (after many attempts) to be impossible to fix.

Matrix chart built using Excel
(more…)
Tags: analysis, blogger typology, bloggers, charts, ibm, many eyes, research, visualization
Posted in blogger typology, research | 3 Comments »
A simple perl script to interrogate the Technorati API
Saturday, January 3rd, 2009
Sometimes (for instance when I’m doing the research for the blogger typology) you need to get a whole load of Technorati data for a whole load of blogs.
This research can (of course) be done by hand. And (of course) for a long list of blogs this would take a great deal of time. Handily, Technorati provides developers with an API that lets you automate those queries. An API (for those of you who don’t know) is an Application Programming Interface – a toolkit provided by a service or application (in this case by Technorati) that lets other computer applications ask it questions and use the answers for their own purposes. It may be helpful to think of APIs as being like the knobs on top of a Lego brick that let you stick other Lego on to it without in any way changing the nature of the brick itself. On the other hand it may not be so helpful after all.
(more…)
Tags: api, bloggers, blogs, perl, research, technorati
Posted in blogger typology, hack, how to | 8 Comments »
Your help needed to develop “blogger typology”
Sunday, December 21st, 2008
(NB: If you have both a blog and a short attention span, please skip the article, and go straight to this short survey. Many thanks!)
What is a blogger? Everyone seems to think they know, and yet the longer I work in this area, the more I realize I know nothing. And the less I know, the more suspicious I become of marketers who use vague terms like “conversation” (which has – after all – become little more than a Latinization of the ghastly “dialogue”.) I can just about understand what Technorati means when they talk about
The ecosystem of interconnected communities of bloggers and readers at the convergence of journalism and conversation.
…but there are an awful lot of long words that could turn out to hide an awful lot. And that’s the carefully thought-out distillation of a bunch of experts. Most of us, most of the time fall back on lazy or confusing language. We talk about “social media” and never stop to think that — depending on who’s doing the talking (and what they have to sell) — what is meant by that apparently innocuous phrase shifts wildly from speaker to speaker.
(more…)
Tags: bloggers, blogging, research, survey
Posted in blogger typology, research | 12 Comments »













