Twitter analyse
January 27th, 2009 AnsiMoin
I love these twitter mashups. More and more services are using the API and adding meta services.
Moin
I love these twitter mashups. More and more services are using the API and adding meta services.
Moin
Lets find some slides on Microblogging, some videos and some examples. When I tell people about microblogging (or as some people call it “twitter“) they look at me like “what a freak!”. But let me try to explain why microblogging is realy something new and different from chat, blogs or SMS. First of all lets have a look on Slideshare what presentations are available on this topic.
There is one very good one in german language:
And one in english with the basic facts:
http://twitter.com/IBM_System_z
http://twitter.com/sametime
http://twitter.com/ibmevents
http://election.twitter.com
http://twitter.com/BarackObama
http://twitter.com/JohnMcCain
http://twitter.com/muentefering
http://twitter.com/hubertus_heil
http://twitter.com/neuepolitik
http://twitter.com/diegruenen_at
http://twitter.com/pofalla
http://twitter.com/schaeuble
http://twitter.com/rolandkoch
http://twitter.com/merkel
I had this idea to use build a real distributed microblogger system a while ago. Unfortunately I was a little bit to late and twitter lost so many links between users (follow and followers) this night. But better now then never. I will post here from time to time parts of the pig picture how to build such a system. This time how to extract the list of friends from your Twitter account and generate a list of RSS feeds out of it.
Twitter has a cool API wich we can use legally. The xml list of users you follow can be retrieved with
http://twitter.com/statuses/friends/USERNAME.xml?lite=true&page=1..n (for me its ansi)
Having at the moment 112 user I follow (yesterday more then 160.
) page 1 and 2 are all my guys.
This small xsl stylesheet extracts the userids. (if anyone is into xsl please help me here. Would be great to extract username, realname and user with comma separated per line. Please add comments if you know the solution, I appreciate it!)
<xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="1.0">
<xsl:strip-space elements="*"/>
<xsl:template match="/users/user">
<xsl:for-each select="id">
<xsl:value-of select="." />
<xsl:text> </xsl:text>
</xsl:for-each>
</xsl:template>
Save this code snip to a file called extractIDs.xslt and call it with the processor:
xsltproc extractIDs.xslt friendsPage1.xml | sed 1d >list_of_ids.txt
xsltproc extractIDs.xslt friendsPage2.xml | sed 1d >>list_of_ids.txt
So now next step howto get the rss feeds out of it. The API offers this call
http://twitter.com/statuses/user_timeline/USERID.atom
Short bashscript like
for i in `cat list_of_ids.txt`
do
echo "http://twitter.com/statuses/user_timeline/$i.atom" >>list_of_rrs_feeds.txt
done
is doing the job. So we end up with a text file each line with one RSS feed. I totally agree its much easier at the moment to call the “user and friend” rss feed from twitter but the idea behind this is to get a list of each user so future systems can really be distributed among many microblogging systems.
So first serious blog entry. I try to install my own instance of identi.ca what is microblogging system. Its based on Laconica. Lets see how to install this system on Ubuntu Server Edition. l.m.orchardDECAFBAD.
Additionally a changed something so here are the description for the latest greatest version. I do not repeat his description only point out the changes.
There is a new version of the xmpPHP library available at least a new release candidate.
http://xmpphp.googlecode.com/files/xmpphp-0.1beta-r50.tar.gz
Beside
cp xmpphp/*.php ../extlib/
also
cp -R xmpphp/XMPPHP ../extlib/
to copy the necessary libraries.
In order to convince apache2 to accept the rewrite it is neccessary to activate the rewrite module with
a2enmod rewrite
/etc/init.d/apache2 force-reload
The XMPP Part is still not running but I try this tomorrow.