Twitter analyse

January 27th, 2009 Ansi

Moin
I love these twitter mashups. More and more services are using the API and adding meta services.

Posted in Tools, Web2.0 | 4 Comments »

Howto extract all followers from twitter into list of RSS feeds

July 24th, 2008 Ansi

I had this idea to use build a real distributed microblogger system a while ago. Unfortunately I was a little bit to late and twitter lost so many links between users (follow and followers) this night. But better now then never. I will post here from time to time parts of the pig picture how to build such a system. This time how to extract the list of friends from your Twitter account and generate a list of RSS feeds out of it.

Twitter has a cool API wich we can use legally. The xml list of users you follow can be retrieved with

http://twitter.com/statuses/friends/USERNAME.xml?lite=true&page=1..n (for me its ansi)

Having at the moment 112 user I follow (yesterday more then 160. ) page 1 and 2 are all my guys.

This small xsl stylesheet extracts the userids. (if anyone is into xsl please help me here. Would be great to extract username, realname and user with comma separated per line. Please add comments if you know the solution, I appreciate it!)

<xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="1.0">
 <xsl:strip-space elements="*"/>

 <xsl:template match="/users/user">
     <xsl:for-each select="id">
      <xsl:value-of select="." />
      <xsl:text>&#10;</xsl:text>
     </xsl:for-each>
 </xsl:template>

Save this code snip to a file called extractIDs.xslt and call it with the processor:

xsltproc extractIDs.xslt friendsPage1.xml  | sed 1d >list_of_ids.txt

xsltproc extractIDs.xslt friendsPage2.xml  | sed 1d >>list_of_ids.txt

So now next step howto get the rss feeds out of it. The API offers this call

http://twitter.com/statuses/user_timeline/USERID.atom

Short bashscript like

 for i in `cat list_of_ids.txt`

 do

  echo "http://twitter.com/statuses/user_timeline/$i.atom" >>list_of_rrs_feeds.txt

 done

is doing the job. So we end up with a text file each line with one RSS feed. I totally agree its much easier at the moment to call the “user and friend” rss feed from twitter but the idea behind this is to get a list of each user so future systems can really be distributed among many microblogging systems.

Posted in Gutenberg2.0 | 3 Comments »

Howto set up your own twitter

July 23rd, 2008 Ansi

So first serious blog entry. I try to install my own instance of identi.ca what is microblogging system. Its based on Laconica. Lets see how to install this system on Ubuntu Server Edition. l.m.orchard has compiled an outstanding description see DECAFBAD.

Additionally a changed something so here are the description for the latest greatest version. I do not repeat his description only point out the changes.

There is a new version of the xmpPHP library available at least a new release candidate.

http://xmpphp.googlecode.com/files/xmpphp-0.1beta-r50.tar.gz

Beside

 cp xmpphp/*.php ../extlib/

also

cp -R xmpphp/XMPPHP ../extlib/

to copy the necessary libraries.
In order to convince apache2 to accept the rewrite it is neccessary to activate the rewrite module with

a2enmod rewrite

/etc/init.d/apache2 force-reload

The XMPP Part is still not running but I try this tomorrow.

Posted in System | No Comments »