Monthly Archives: September 2010

Charity Hack 2010

Computing, , , , , ,

The weekend of 18-19th September 2010 saw PayPal open their doors to a bunch of developers for Charity Hack 2010.  With the combination of API’s from JustGiving, PayPal and MissionFish the idea was to create something in 24 hours for charity  or a good cause.

After much deliberation the week before over what to build (I really wanted to make a Blue Peter style totaliser using an Arduino but I couldn’t get the equipment there and was worried about setting the fire alarms off with the soldering iron) I decided to play safe and fix a real world problem I had.

As I am sure you are all aware I organise the Goodwood Roller Marathon each year and raise lots of money for charity.  While I have managed to automate a lot of the administration, the collecting and tallying up of sponsorship is a huge admin task, especially after the event when we are all tired.  The annoying part is that we send a lot of our users to Justgiving to create their pages but have no way of knowing which page they registered and so no way of tracking how much money our event has been responsible for raising!

The solution seemed simple.  If we could use the JustGiving API’s to help the user create a sponsorship page then we should get a notification of that page.  If we keep a table of these pages we can check them regularly and keep an up to date total of all the money our event has raised.

After a few shout out’s on the event twitter wall I was introduced to Nathan O’Hanlon & Justen Doherty, two PHP developers that were looking for a project.  We all talked to the lovely David Whitney from JustGiving who hinted that this sort of functionality was already in the pipeline but was never finished so we decided to show them how it should be done :-p

I’m sure I could bore you all silly with the rabbit holes we went down over the 24 hours but things are never as easy as you think, especially when you are coding fast and even more so when you haven’t had much sleep.  Nathan & Justen decided on the symfony framework and set to creating a GIT repo while I went off to register aggreg8.me and create the webspace.

There were many questions about the JustGiving API which David helped with.  Lets just say the API had a few bugs too although a lot of the bugs were fixed in the same 24 hours.  Annoyingly the API allowed for all donation pages to have an Event ID however there was no way of finding out what a valid event ID was let along then searching for them and indexing them!  I really didn’t want to have to replicate the pages that JustGiving already had using the API but it seemed there was no choice.  By the time night came we hadn’t done much coding but had a good idea of the direction.  Nathan & Justen went home for the night and I stayed up designing the front end to the website.

I was disappointed not to be building anything with Arduino but had bought it along with the old BiscuitTrain rig.  As it was night time and I wasn’t going to use it now I donated it to a fellow charity hacker who made Wreck it or not! (picture) People donating money would choose to make the train go faster or slower until it crashed.  I’m glad it got used 🙂

Morning comes after a quick nap and Nathan returns for the day.  Justen has been up all night coding at home so is now going to bed.  We quickly add my front end to the project but now comes the integration which takes ages and all the way up to the 13:30 deadline.

After another food break (many have said it, we really were fed well) we all did our 3 min presentation.  I kinda rushed it but I think I got our point across.  The great news is that the program manager for JustGiving came to us at the end to say that he would like to talk about the project in the future.  I really hope they do contact me and listen to my calls for help, I really do think it will make their platform stronger and better… plus I have VirginMoneyGiving already contacting me and asking what I would like :-p

IMAG0230(Loads of people took pictures of the event including pics of me but it seems very few made it online)

In all the event was a brilliant first hack day for me and a got a lot out of it.  Our project http://www.aggreg8.me/ is now live and while it’s not using the live API’s yet (as JustGiving haven’t officially launched them yet) Nathan has been doing lots of work in the days after the event to make sure it’s a strong and stable product that fully works.  It’ll be interesting to see what JustGiving do next, I will be sure to update you all.

A huge thank you again to Nathan & Justen for all their help and to everyone else for a fantastic 24 hours 🙂

Can you really delete a tweet?

Security, , ,

The lovely James Firth has just announced that he will “delete all my old tweets, and only keep the last month or so”.  I think he is being foolish as I don’t believe it’s possible to delete things off the interwebs.  As such I decided to find out which of us was right!

The Test

  1. Post a tweet (Done 20th Sept 2010).
  2. Wait for it to be picked up by search engines and search tools.
  3. Delete the tweet (Done 25th Oct 2010).
  4. Wait to see how long it takes for the tweet to be deleted from these sites.

The Tweet

This is the tweet I will be deleting…

[blackbirdpie url=”http://twitter.com/dogsbodyorg/status/25050638391″]

I’m embedding it with the Blackbird Pie WordPress plugin, It will be interesting to see if it goes from here too!

The Results

Will be posted here when I have done the test.  Add me to Twitter or subscribe to my RSS to find out! 😉

  • Google – Deleted but took over 2 months.
  • Google Realtime – Deleted in less than 24 hours.
  • Bing – The tweet never appeared in their search.  Can’t test.
  • Yahoo! – Deleted but took over 2 months.
  • TweetMeme – The tweet never appeared in their search.  Can’t test.
  • Twitpic – Not much you can do if someone takes a picture of the tweet.
  • Retweet – There is nothing you can do if someone has already retweeted you
  • Embedded with Blackbird Pie – Deleted some time before 01 Mar 2019 but probably because Blackbird Pie has long since broken :-p
  • topsy.com – Still appearing in the Topsy index as of 28 Feb 2011.
  • flavors.me – Still appearing in embedded sites as of 28 Feb 2011.

If you have written something news worthy that someone else has blogged about or discussed then no, that content can obviously be copied and quoted without issue.  And while tweets about your breakfast may be deleted by large sites such as Google and Yahoo there are plenty more that do not honour Twitters deletion protocols.

In short, I wouldn’t bother deleting things of the Internet.  All you are doing is making work for yourself.

Any other sites? Suggest them in the comments.

The Firehose

This is not a new test.  Until recently deleted tweets weren’t removed from Twitter’s official search resulting in services such as Tweleted.  With more and more sites drinking from the Twitter firehose (Twitters name for having a live feed of public status updates) it will be come harder and harder to stop tweets from being archived which is why I think it’s important to test this every once in a while.

Interestingly Twitter have blurred the line of firehose access with the launch of their new streaming service as a lot of companies that want to drink from the firehose only actually want a subset of the data.  e.g. TweetMeme only needs to index tweets with a URL in them. The Streaming API help has this to say about deleted tweets…

Streams may also contain status deletion notices. Clients are urged to honor deletion requests and discard deleted statuses immediately. At times, status deletion messages may arrive before the status. Even in this case, the late arriving status should be deleted from your backing store.

… urge != must.  It’s not in their T&Cs either that I can see.

I believe there are at least tens of full firehose users and hundreds of streaming users if not hundreds and thousands respectively.  Either way, the number is only going up!

Oh and we aren’t just talking websites and services here. The US Library of Congress has access to every public tweet ever written 😉

P.S.

  • I started creating a list of Twitter Firehose users as I don’t believe any such list exists.  Feel free to update and add to it, it’s public 🙂
  • I have been told to “play nice”, this is not a personal attack on James at all who is a top bloke, this is just an open debate and test.