The Google Alphabet

February 9th, 2010

Start typing something into google, and the now established “autocomplete” or live suggestions or whatever it’s called today pops up.  I thought I’d take a look at the Zeitgeist, and see what each letter brings (and the #2 result in brackets).  All pretty big-brand, although the second most common search beginning with an “r” is “reverse phone lookup”?  Seems like an unanswered mega-site right there.

  • amazon (aol)
  • best buy (bank of america)
  • craigslist (cnn)
  • dictionary (disney channel)
  • ebay (espn)
  • facebook (facebook login)
  • gmail (google maps)
  • hotmail (hulu)
  • imdb (itunes)
  • jcpenney (jet blue)
  • kohls (kmart)
  • lowes (lady gaga)
  • myspace (mapquest)
  • netflix (nfl.com)
  • office depot (opm)
  • pandora (photobucket)
  • qvc (quotes)
  • realtor.com (reverse phone lookup)
  • southwest airlines (sears)
  • target (tiger woods)
  • usps (ups)
  • verizon wireless (victoria secret)
  • walmart (weather)
  • xbox 360 (xm radio)
  • youtube (yahoo)
  • zillow (zappos)

admin data mining

Twitter Mining

January 2nd, 2010

Twitter, for all its fans and detractors, generates a LOT of data.  It may only be a very small percentage of the world’s population who tweet a lot, but even that can be representative of interesting/important trends and changes.

Oh, and by the way, is twitter worried about this twitter.com traffic trend (courtesy of compete.com)?

But in terms of mining the human chatter that happens through Twitter, who is doing anything interesting?  I didn’t find much:

1. TweetDeck’s  TwitScoop

Dodgy naming aside, this column in tweetdeck is one I keep switched on.  But a keyword tag cloud isn’t exactly world-shattering in 2010.  Still, it’s there, and while the screengrab above doesn’t tell me much (and I’m still not sure what/who “snead” is, even after a search), it’s a good finger-on-the-pulse.

2. TrendsMap

Now this is more like it (and a better name).  A google mashup with (another) tag/word cloud floated on top, it gives an overview or trending topics, along with a real-time snapshot of individual tweets.   And no, I’ve no idea why blasphemy is a hot topic in Ireland right now…

 3. Neoformix

Now this guy I have a lot of time for.  He’s particularly well known for his “Twitter Stream” graphs, which shows word usage trends over time, as below. 

However, head on over to his projects page, and you’ll find charts that include “time of day word correlations” (as below), “Twitter Venn” (twitter Venn diagrams) and a host of other tools. 

So, I know Jeff at Neoformix isn’t the only guy doing interesting analysis of Twitter data, but what surprises me is how few people seem to be working on it – at least that I’m aware of.  Sure, the fact that the word “drunk” is tweeted most between midnight and 5am isn’t going to change the way we see the world – but what about if a brand name suddenly takes off?  Or the word “recession” is on a downwards trend, or “flu” on an upwards trend? 

More Twitter Mining, please…

admin Uncategorized, data mining

What is real-time, really?

December 13th, 2009

alarm-clockThere’s a whole lot of talk about “real time” just now – from Google’s realtime search, to games, processing power, and medicine.  And yet it strikes me that “realtime” (or is it real-time or real time?) is overused, and often meaningless.

Wikipedia defines realtime as “when things respond to events as they occur“.  Well, I respond to events as they occur to me, but sometimes hours or days late…   Dictionary.com defines it as “of or pertaining to applications in which the computer must respond as rapidly as required by the user or necessitated by the process being controlled.”  Hm.  Well – if the user required a response only the next day, would that still be realtime?  Selecting “shutdown” on my PC shuts the PC down in about 5 minutes, which when I’ve walked away from the PC is as rapidly as required, but is hardly realtime.

It seems like the realtime I thought I knew is actually some concept which spans almost any sort of delay.  My definition would be something much closer to “simultaneous” or “directly after”. In other words, within a short enough time-period that an average observer would say that the result/response happened right after the cause

So if I click a mouse button to select something on screen, I expect that something to respond immediately.

And what is immediate?  Well, as an example in tests of human reaction time (often by catching a falling ruler between finger tips), the average human reaction time tends to be in the range of 0.2 seconds, or 200 milliseconds.  So it might be fair to say that anything that happens within that time period would be pretty immediate, or without perceptible delay.

So given that definition of realtime, what is ACTUALLY realtime?

Twitter is mainly not as most updates are actually read out-of-sync
- SMS and email are mosty not, for the same reason
Communicating by talking IS generally realtime
- Google’s search is barely realtime, if at all – it’s just very recent
- The feedback we get from machines can be realtime – from clicking on things, to turning the steering wheel, to turning on a light….

Actually, thinking through the options – there’s not much in life that is actually realtime…

admin Science, Technology, Web

Reading My Mind

November 29th, 2009

As we try and link ourselves ever closer to technology, the industry of human-computer interfacing is developing rapidly.   I thought I’d check out the state-of-the art brain-PC interfaces, on the basis that if any of them seem good enough, they may change the way we use the internet forever.

ocz1. OCZ Technology – Neural Impulse Actuator (£73)

Pitched as a gaming device, this headband combines a electromyograph (which detects the electrical potential generated by muscle cells), an electroencephalogram (which records electrical activity across the scalp), and electrooculograph (which detects electrical activity associated with eye activity).  Phew.  That’s the pitch anyway, although I think it may be simpler – it essentially detects electrical activity at 3-4 spots across the forehead, and uses software to try and discriminate between the different sources of that electrical activity: your forehead muscles, your eyes, or indeed your brain.

Various reports including this one from OC3D suggest that after a LOT of training, the headband can allow you to shoot enemies in games by slightly raising an eyebrow, or clenching your teeth.  Response times (promised as at the speed of thought) haven’t been shown to be much faster than mouse, even after quite some training.

Verdict: Unproven, probably too simplistic, but an interesting start

emotiv2. Emotiv Systems – ($299)

Emotiv have been developing their headset for a couple of years now, and it’s finally being released on New Year’s Eve.  Again, their target is console games, and Emotiv use both scalp electrical activity, and sensing of facial expressions to deliver gaming control.  Their 2008 launch was delayed because “The public demo didn’t go as planned; the device simply didn’t work in front of the media who attended the press conference”.  Hm.

As it hasn’t been launched, it seems that few independent review have been done, so the jury is still out.  However, just on the basis that it detects facial expressions, it probably has greater potential than OCZ’s

Verdict: Unproven, but facial expression recognition could be interesting

neurosky3. Neurosky Headset – ($199)

Neurosky appear to have built the biggest ecosystem around their headset – games, integration with music visualization, bluetooth cellphone integration.  However, their headset only has 1 (yes, 1) sensor, which supposedly shows your “emotional state and how you react to the world”.   This really is the most remote from believable “brain control”.

Verdict: Interesting (and smart commercially), but ultimately just a toy

Conclusion
I started looking at this area thinking I’d find a bunch of companies trying to commercialise “thought control”.  I only found three key players, and none of them represent what I can see as being a realistic attempt at getting mass-market mind control of computers.

Part of the problem is that it’s hopelessly simplistic to try and read the brain by measuring electrical activity across the scalp.    Of course, it can result in some simple communication or control of a cursor on the screen – which is a life-saver in the caseof severe disability or paralysis, where it’s enabled a patient to communicate.  However, the ability to do complex tasks just isn’t possible yet (or ever?) without invasive brain surgery – or a far greater number of more sensitive and calibrated sensors across the scalp.

However, there is hope in sight.  DARPA, for instance, has $4m in 09/10 for “Silent Talk” – a project that aims to “allow user-to-user communication on the battlefield without the use of vocalized speech through analysis of neural signals.”  And DARPA generally does interesting things with its research budgets – cars that can autonomously navigate complex environments being probably the highest profile example.

I’m watching this space – the day we can control computers using a mix of keyboard, mouse AND thought (I don’t believe that thought will, for a long while, replace manual control) is that day that the internet becomes truly fast and immersive.  I can’t wait.

UPDATE: The crew at Neurosky were switched on enough to catch this post, and send me a whitepaper with some stats in it.  Seems their single electrode compares favorably with a Biopac, a well-used medical wet-electrode EEG system.  I don’t have time to analyse the data, nor can I verify it – but if it’s true, then good job Neurosky (I’m actually more impressed with the fact they caught this post).  I’m still unsure about how useful the technology is today, though…

admin AI

The Fascination with Me – updated

November 23rd, 2009

So I’ve got my results from 23andme – having sent off my sample some weeks ago.  (Thankfully, nothing too shocking in there!)

So, here’s a taster of what you get:

1. Clinical Reports:  The screenshot table below is a snapshot of my risk for various conditions, such as:

  • Type 1/2 Diabetes
  • Certain forms of cancer
  • Crohn’s disease, etc. 

They are the data that clinically 23andme are sure enough of to actually lay them out this formally.  I’ve blanked the particular conditions, but you get the gist.  Also included in this section is information on:

  • Traits (such as the ability to taste certain bitter flavours, lactose intolerance)
  • Carrier status of certain conditions such as Bloom’s syndrome and Canavan disease
  • Drug response to such drugs as Plavix (a blockbuster heart drug)

risks

2. Research Reports – this is analysis that “has not yet gained enough scientific consensus to be included” in the Risks section as above.  It includes things such as:

  • Blood pressure
  • Dependencies and addictions
  • Asthma
  • Headaches

3. Ancestry- this shows you a map of your maternal and paternal ancestry, as below – along with (as in all other sections of the site) a healthy dose of background and eductional material

map2

4.  Surveys – the site has a lot of surveys, mainly health/psychological, and the results of those are both interesting to see, and obviously are fuelling 23andme’s knowledge of how genes influence all kinds of health conditions.

map3

5. Sharing – a fascinating part of the site, and one I haven’t yet had time to dig into.   You can select to share your genome with anyone else on the site, at a basic or full level – which enables a bunch of functionality. 

compareing

The somewhat obvious extention of this is to work out what the combination of your genetic makeup and a potential partner’s will put your potential children at risk of, with the Inheritance Calculator

comparing2

Now that adds something to the mate-selection process, huh. 

Actually of all the features and content on the site (and there’s a lot of it), the two elements that raise most people’s eyebrows when I tell them about the service are the disease risks, and the inheritance calculator.   As odd as it seems, I think both represent something really pretty important: the ability to help guard against future risk. 

If I know I’m at a slightly higher risk of some disease because of my particular genetics, AND I know something that I can do about it (eat more broccoli or whatever), why wouldn’t I do that?  Or prepare my kids for it?

I spend my waking hours looking at ways to work out how people behave online and use that information, and to me the analysis of genetic profile is a (long) extension of this – it’s part of the mix of technologies that will enable us to understand US better.

Overall I’m highly impressed with the site – there’s a ton of information there, and obviously by submitting surveys and detailed further information the site will improve.  Over time, they’ll add the ability to analyze and risk-profile more health conditions. 

On a lighter note (but the same topic area!), I’m about to try out facionic.com – results when I get them…

admin medicine

Not everyone is 2.0 (most aren’t even 1.0)

November 8th, 2009

It’s pretty easy to get caught up in being a wired-social-media-twitter-myfacespace-er and forget that actually, most people aren’t that wired.  By which I mean, most people on this 3rd rock from the sun aren’t participating in the heady-Web 2.0 life, and even those we might assume are, are not.  I meet a lot of people who would normally be included in the statistic of “internet users” who, unsurprisingly, are still largely untouched by the latest developments.  Some basic info-graphics (if you can call them that) to illustrate:

image-1

So, 5bn people aren’t internet users, versus 1.7bn who are (numbers courtesy of World Internet Stats).  A significant majority of the world’s current population who wouldn’t know a tweet from a poke, let alone who are actively using the internet for any purpose whatsoever.

Next, let’s assume that really wired internet users are members of one of a couple of key sites: Facebook, LinkedIn, or Twitter.  Sure, we could add MySpace, Orkut and so on into the mix, but it’s fairly obvious that the crossover between the different sites is going to be heavy – i.e. most Twitter users will have a facebook account, listen to spotify, whatever whatever.  Another high-tech infographic for your enlightenment:

image2

(The twitter number I’ve derived from various sources, the other figures are from the sites’ own published stats)

Finally, here are a couple of other indicative statistics to keep in mind:

Obviously I’m not saying any of this to try and claim the “internet” is dead or broken or flawed.  The fact facebook has 300m accounts is hugely impressive, and a feat not achieved by any business before that quickly.   In fact, I’m saying the opposite: I’m underlining the huge potential still wrapped up in its growth, despite few people in our worlds talking about that growth, and despite the temptation to assume that everyone is equally tech savvy.

I’m fully aware that those with businesses exposed to BRIC countries know all this – and are building their businesses based on this potential growth.  But I’m also confronted daily with a significant section of the web-culture in the UK/US (including me) who can take a fully-wired society for granted.

Back in 1995 when I started my first company (a web agency) I thought then that maybe I was too late…!  Fact is, we’re still all very early to the game.

admin Web

Why we blink together

November 1st, 2009

At university I did a thesis on how people react to movies (part of which went into a chapter I co-wrote with Julian Friedman for his book How to Make Money Scriptwriting).  Turns out, if we empathise with a character on screen, we mimic what they’re doing with small (undetectable) muscle movements – if they’re running, our legs twitch, etc.

eyeWhat’s even more fascinating is how we SEE the movie.  When we blink, we lose up to 10% of our viewing time.  So it’s really important that we time those blinks to moments when we won’t miss anything too important happening on the screen.  And that means that in an average movie (or YouTube clip), most of us will blink at the same time.

Synchronized blinking, in short.

A recent study discovered that it’s not always when expected (i.e. a scene break), but at points where something has completed, or the main character is off the screen for a moment.  So the result of a natural moment of low interest, when our brain calculates it can give the eyes a break.

Part of that seems obvious to me (our eyes would dry out if we waited for scene endings), but the fact that almost everyone anticipates the same best place to blink is pretty interesting. 

Watching where people blink could be a pretty strong indicator of interest not just in movies, but in video ads (if we blink when they show the brand, opportunity lost), in top-level sports (especially fast-moving sports like table tennis) in warfare (when do fighter pilots blink?), and so on.

Blinking useful.

admin Psychology, Television

Why Twitter doesn’t matter.

October 25th, 2009

Presentation1b

Who cares???

I wrote a while ago about the Palm Pre (now available in the UK) unifying messaging.   It makes sense – all your messages to me are as one.   

The thing is, I don’t care how your message arrives.  If I’m at my work PC, sure a Skype message is handy, it’s right there.  In a meeting?  Email is pretty good.  On a train with just my Blackberry – well, any mobile message works.   But really, whether to message me in LinkedIn, Twitter, email - it doesn’t matter, it just makes your and my life harder working out which one to use.  We’re supposed to be in a new bright era of unparalleled communications - but, it’s actually a mess

Twitter?  Handy when I have Tweetdeck open.  And crazy when I get alerted to new messages by email (talk about duplication).  Can I be bothered to install twitter clients on my Blackberry so I have yet another format of message to read?  Is a tweet any more useful than a Skype IM?  Do I remember whether you told me about some new great thing via MSN rather than email?  No, no and no!

Sure, there are different ways you might want to message – just to me, just to our group of friends/interest group, or to the world including me.   But that doesn’t need 10 different platforms, 10 different interfaces, 10 apps on my iPhone (disclaimer: I don’t  have an iPhone, this guy outlines the reasons why pretty well).   It just needs a simple setting connected to the message: like a “purpose” or “audience” label.

We’re running a real risk of losing out on the benefits of realtime communication by getting caught up in new brands that merely provide a way of sending messages (I’m looking at you, Twitter), rather than ways of getting that message to me in the most appropriate, useful, immediate way. 

It’s a little bit like providing gas to my house in pipes that are colourful, light up, have cute names, and make their journey via London’s top landmarks.  I don’t care – I just want the gas that comes out of the end, and feeds my boiler and oven.  Even more than that, I just want the heating it enables, and the food that comes out of the oven.  So, even if the gas itself is replaced by some new energy source, I’d be just as happy.

It’s the message that counts, not the medium.

admin Technology, Usability, Web

The fascination with ME

October 18th, 2009

Tonight, in about 1/2 hour, I’m going to take a saliva sample and ship it off to the States. 

A company called 23andme is then going to analyze that DNA, and tell me my risks for 118 diseases, my ancestral path and allow me to navigate other people with similar DNA…

This is mainly thanks to Esther Dyson’s persuasion, who has always been enthusiastic about the service (she’s also any advisor to my Company, Cognitive Match).  And, in fact, the moment the service was proposed (which from memory was still a year starting with 19) I knew I’d be signing up at some point.  The thing is, it’s at least 50% of what defines ME, it’s my DNA.  (Although note that researchers are finding other features of our DNA, including how it is folded, could be just as important - thanks to @christophebacon for that one).

billSo Bill Moorier’s app (http://abstractnonsense.com/mri/), “Inside my head” caught my eye for the same reason.  If you fancy, you can use this app to navigate around Bill’s head, presented in a full set of MRI scans… No, I’m not totally sure either why you would want to see inside Bill’s head – but I wouldn’t mind seeing inside my own.  Especially if it was labelled up with facts about brain areas, comparisons with other people’s brains and so on. 

That’s only the start, of course.  Twin this data with eHRs (electronic health records) which we’ll all be getting access to within 3-5 years  (Google Health is already delivering this, and Microsoft and others are working on int), and you have an electronic record of YOU.   Then what? Suddenly, you’ll be in control of your health – all in one place, at one time. 

And the combination of that data will make some amazing things happen in medicine – your genes, combined with your medical history, your travel plans, what you eat every day… Not only will it enable huge advances in personalized medicine, but connections between your health and your life will pour out of this thing.  And ultimately, we will all be a bit healthier.

fitbitSo, getting 23andme to analyze my DNA, and considering buying the recently buzzed-up FitBit is the first step along that road.  I realise many people wouldn’t find all of this healthy, and it might even be more stressful/worrying than not knowing anything.  But for now, my curiosity is outweighing all that.

I’ll let you know if it changes once 23andme is done analyzing…

admin medicine

Information IS free (it doesn’t just want to be)

October 11th, 2009

The concept that “information wants to be free“  has been around one way or another since the dawn of time.   News at the dawn of time (whenever that was) was most likely passed on by word of mouth – town criers, or neighbours in the cave next door.

These days it’s being touted as, amongst other things, the reason for the downfall of the newspaper industry.   As in the table below, only ONE of the UK national papers (the Daily Star, more of a celeb-paper than a newspaper) is up year-on-year in terms of circulation, and some are falling by as much as 15%. 

abc

So what does “information wants to be free” actually mean?  As far as I can tell, the raw data that is the news (i.e. what’s happened) isn’t something the general public are any more willing to pay for.  As long as there are ways to subsidize the collection (or recycling) of news online, some or all of it will be offered free, and therefore no-one will be willing to pay for any of it. 

Some commentators bite back with comparisons like “Information doesn’t want to be free any more than gasoline wants to be free” – which is patently nonsense.   If I could find a business model to make gasoline free, gasoline would be free, almost overnight, everwhere. For instance, if I when filling my car up I watched 5 ads, filled out a long personal questionnaire, and did my weekly online shopping with an advertiser provider – there’s my free gasoline, job done.

townCrier3as-776170The problem is in part that information covers a huge array of things: from “what time is it?” to “which stock should I buy” – and a whole complicated spectrum in-between.  And no-one can draw a line to say where the charging should begin.

The standard response of newspapers is that they don’t actually present the news – they present a mix of news, analysis, and “premium” news such as financial information or sports results, and so on.   It’s a form of entertainment.  Here’s my take on that:

  • I reject the “premium” notion, as all news suffers from the same free-effect: if someone somewhere is willing to offer it for free, everyone everywhere expects to get it for free.  Even the FT online has only got around 117,000 paying subscribers around the world
  • Analysis indicates that someone (or some people) who are smart have spent (chargeable) time processing the news, and coming up with useful views, slants and summaries - that we ourselves couldn’t or wouldn’t want to do.  It might be valid, but then 1billion blogs, including this one, do the analysis piece (if you can call it that in my case) and give it away.  Citizen journalists take the photos (more quickly).  It may not be as high quality – but then neither is the video on YouTube, and look where that got it
  • The entertainmentpiece is probably the piece the Daily Star has got right – light on the news, heavy on entertaining, light and untroubling content

So what can the newspapers actually do?

1. Put up a “pay wall” so high that people actually turn back to cheaper print: As in the Newport Daily News (http://www.newsweek.com/id/214607).   I think this is a crazyand short-term idea.  In fact a pay wall of any kind is a crazy idea.  The common sentiment is that if Murdoch does it, everyone will have to do it.  But that’s bizarre thinking.  If Murdoch and everyone else puts up a pay wall, I’m launching a free newspaper, and boy am I going to get a lot of traffic.

2. Find smarter ways of monetising content – contextual ads are okay, but tighter links into other ways that consumers spend online is smarter.  This is my favorite approach.  Newspapers still (just) have a great mixture of brand, loyalty, customers and quality editorial staff  – and can churn out the content to support the revenue models to keep the industry alive.

3. Forget chasing the “next big charging thing”like ereaders.  Ereaders will very soon (if Apple has its way, by next year) be always-on web terminals.  Same story, same argument, and same free

4. Create entertainment products, like the Daily Star.  That seems to work, still.   But that may in part be because the audience of the Daily Star has yet to become as fully web-enabled, and in time too that advantage will erode

5. Realise that free means “free to the consumer”, not “completely without revenue”

In conclusion, I’m on the “information wants to be free” side, but absolutely don’t believe that means that there won’t be revenue models or a place for what we today know as newspapers.  In fact, as information power-houses, they’re really well positioned to take advantage of digital.  If only they’d just focus more on that, and less on lamenting the demise of paper and ink.

admin Web, news