21st century data convergence: surf or swim

A Times UK piece, 10 ways data is changing how we live, says that “the availability of new sets of data” is changing the way we live. Five years ago at IC2 Institute in Austin, we were talking about digital convergence, and those talks spun off an organization called the Digital Convergence Initiative, the idea being to build a local business cluster of convergent companies. We were ahead of our time, and it was hard for many to get their heads around how such a “horizontal” cluster would work. We were onto an effect of convergence that could be pretty interesting: the edges of verticals will blur, and companies that before convergence had nothing in common will find affinities and synergies that create new forms of business. The clearest and most obvious example we saw was digital media, i.e. radio, television, music, and film all coming together as data and presented through smart, computer-driven systems. Apple, by understanding this (or maybe it was an accident), has evolved from a somewhat successful niche computer business to a dominant position in the world of digital media. The Mac is as much a media device as a computer, and Ipod is a household word for convergent media. The challenge today is dealing with the abundance of media, and if you produce media, building a reasonable audience for your productions. As I watched the unusually entertaining Emmys last night (and noted the velocity of the related Twitter streams), I realized that the television networks may yet figure out how to recover and build audiences across platforms. I noted knowing social media refernces, and was no way surprised to find the Emmy show available online this morning, especially the opener with Jimmy Fallon and the cast of Glee (et al) performing Bruce Springsteen’s “Born to Run.”

I called this post “surf or swim” – thinking of two ways people will take abundant data. Some will surf the waves, others will dive in and go deep with it. Note that I didn’t mention “sink.” I’m an optimist, expecting evolution over implosion.

How was the Picture Quality of “The George Burns & Gracie Allen Collection”?

Got an email from Netflix asking how George and Gracie looked. I responded that the quality was acceptable, but that’s only part of the story. It was actually phenomenal, if you consider that I was streaming it over my iPhone with Netflix’s new streaming app. I’d say that digital convergence has arrived… I was sitting in a movie theatre, the Alamo on South Lamar, in Austin, waiting for a film, and showing Marsha the Netflix app (which wasn’t too much of a distraction from the Sudoku app on her phone). I could stream any episode of a favorite 50s television series and any of hundreds of films. We’ve been alternating Netflix streaming, more and more of which is HD, with Blue Ray DVDs. I have more media than I can possibly track, and persistent opportunities for new media experiences. I’m in hog heaven.  Marsha and I took a walk yesterday and talked about the challenge of managing anxiety of the seemingly endless possibilities vs inherently scare opportunities – making choices about how we fill our time. We’ve been working many hours lately, so our cognitive surplus is increasingly scarce.

But I’ve been making time to watch all the old episodes of “Kolchak: The Night Stalker,” and re-experiencing the 70s. (Where’s my leisure suit?)

Pay attention

I ran across A.O. Scott’s video review of Errol Morris’s “Fast, Cheap, and Out of Control,” a documentary that weaves together interviews with four men who have an “endless, absorbing facination with what they do.” It’s clear that the four – a lion trainer, a topiary sculptor, a mole rat specialist, and a robot scientist – focus much, probably most of their concentration on their particular endeavor.

As so often happens with me, I was already thinking about attention when I found this particular data point that brought my thinking into focus. I had just been reading an article about Texas Tribune’s recent QRANK Live event, which I sadly missed – sadly because I’m a QRANK addict and was signed up intending to go. QRANK is a game you can play once a day via iPhone, iPad, or Facebook. It’s a quiz where you respond to fifteen out of twenty multiple choice questions that are presented. The questions are categorized (Entertainment, Science and Nature, Literature, History and Place, Life, Business and Government, Sports) but the categories are broad, so they’re all over the map. Successful players are eclectic, have read broadly, have heads full of random inconsistent facts. I’m often surprised at what people know (or know enough to guess correctly). I’m an average player, though a few years ago I would have been much better, but I’ve become more focused lately. I often say that “my head’s too full,” but I expose myself less often to facts I don’t seem to need and more on facts that are relevant to my work in specific areas.

The four guys in the Morris documentary probably would not have done well with QRANK. They’re also very focused on what they do, and that focus makes them very effective. But it also makes it less likely that they’re soaking up trivia.

You may think I’m going to say I think this narrow focus is better, that real genius involves focus and concentration on “just one thing.” But I’m actually concerned that a narrow focus constrains creativity. I find that when I do cast my net more widely, I find connections and synergies that I would miss if I was always narrowly focused. What’s important is balance: be focused on what you do but allow time for exploration.

Related to this is the problem of attention, and I think that’s where we really have an issue. I just spent 3-4 years studying and thinking about social media, which meant that I was also using social media more and more. Much of the activity so categorized is happening on Twitter, which I refer to as “drive by” conversation. Twitter conditions us to share and take small chunks or packets of diverse information. Thought many attempt conversation via Twitter, real conversatons via microblog form are fragmented and constrained. Facebook is similar – in its activity streams longer conversations do break out, and are still more coherent, but they’re still short bursts, all over the map, and we’re in and out of them quickly.

I find value in Twitter and Facebook conversations, and I appreciate the fact that I can sustain so many relationships, ranging from strong to weak connections, in those spaces. I’m a social media advocate and strategist, and I think we’re evolving a rather amazing environment for all sorts of productive communication and organization that were never possible before. I could go on about this at length.

But the point I’m getting to today is that we need balance. We need to work on our sustained attention and have places to go for sustained, coherent conversations. I’m personally working to manage my attention, be disciplined and focused, without losing the value of random online exploration and the power of serendipity.

Clay Shirky at Google

Talking about concepts and stories from Cognitive Surplus: Creativity and Generosity in a Connected Age. Talking about using the cognitive surplus to leverage digital opportunity and human generosity, producing productive and amazing things. “The key thing here is not so much about the technology itself, but the culture that forms around it.”

A difference image

Ann Corwin created this terrific painting of Charles Babbage’s Difference Engine and posted it at her site, Existence is Wonderful. She’s using a color palette that fits the tones in her living room – I think it’s an effective interpretation.

More on Babbage and his machine here:

Steve Ivy: The Voice in the Stream

My thinking’s focused on activity streams lately, thinking of them as lifestreams – increasingly people are putting their lives online through various social platforms like Twitter, Facebook, Twitter, etc. Also via blogs or similar structures for holding longer form content.

I found this post by Steve Ivy. He’s talking specifically about the third person perspective in autoposts that record users’ actions, vs content that users posts. Interesting point about Twitter – it’s mostly comments rather than actions (aside from location app checkins, e.g. Foursquare and Gowalla).

Steve doesn’t like the third person for these reports, but I’m not clear there’s a better way. Imagine a string of “I did this” posts – it’s more efficient and clear to say that “Jon did this,” rather than “I” with a signature or an avatar.

Good point about how the Flickr UI makes the third person reports less prominent, stressing their ambience relative to actual comments.

How much of this stuff do we really want to know? I want to have conversations with people online, I don’t necessarily care as much what they like or unlike, what they added to their Netflix queue, where they last checked in, what they scored on QRANK, etc. Well, actually, I do care about the latter, if they scored less than I did.

I don’t necessarily want these third person reports to go away – they add to the sense of activity, the life of the system. But I can see where it makes sense to turn down the volume on those things and stress comments.

Digital Habitats/technology stewardship discussion

Digital HabitatsNancy White, John D. Smith, and Etienne Wenger have written a thorough, clear and compelling overview of the emerging role of technology stewardship for communities of practice (CoPs). They’re leaders in thinking about CoPs, they’re smart, and they’re great communicators. Their book is Digital Habitats; stewarding technology for communities, and it’s a must-read if you’re involved with any kind of organization that uses technology for collaboration and knowledge management. And who isn’t?

It’s my privilege to lead a discussion with Nancy, John, and Etienne over the next two weeks at the WELL. The WELL, a seminal online community (where Nancy and I cohost discussions about virtual communities), is a great fit for this conversation. You don’t have to be a member of the WELL to ask questions or comment – just send an email to inkwell at well.com.

Blogchat and mutation

It’s hard to scale conversations beyond some manageable number of participants. Christopher Allen, in an excellent article on Dunbar’s number and other potential limits of social scale, argues that the optimimum limit is around 5-9 participants, possibly as many as 12.

In last night’s #blogchat on Twitter, I saw an example of attempted conversation beyond any reasonable scale, yet it did kind of work in that participants felt they were getting value from the conversation, and were excited and stimulated by the firehose of tweets and retweets.

I’m not sure “chat” is exactly the right word for this kind of conversational explosion where it’s difficult to track specific comments and ideas. In the Tweetchat application, a dozen or more comments would appear every few seconds. My experience was one of zeroing in a best I could, tracking only a fraction of the conversation. That’s the way Twitter generally works, anyway, as you scale up – you’ can’t hope to follow everything that’s said, so you dip in and out of the stream of expression. It’s nonlinear, chaotic; what I sometimes refer to as “drive-by conversation.” It feels very ADD. On the other hand, it’s stimulating, and I never fail to learn from these conversations, however disjointed they may seem.

I thought the experience would be more poweful as an asynchronous forum – that Twitter might not be the right tool for this kind of conversation. I posted so: “I wish we had this same group talking in an asynchronous forum to facilitate attention and focus.” Someone responded “That’s what the transcript is for – attention & focus.” So this is more like a blast of ideas, a group brainstorm, not quite a conversation, if you assume that conversation is sustained and coherent exchange of ideas, somewhat linear and trackable.

My concluding point is that we’re creating new ways of communicating that don’t necessarily acknowledge presumed limits of scale. We can say that meaningful conversation or teamwork has a limit of a dozen particpants, but we’re pushing that envelope hard. Same with Dunbar’s number, “a theoretical cognitive limit to the number of people with whom one can maintain stable social relationships,” presumably 150. The Wikipedia article for Dunbar’s numbers says”this limit is a direct function of relative neocortex size, and that this in turn limits group size … the limit imposed by neocortical processing capacity is simply on the number of individuals with whom a stable inter-personal relationship can be maintained.” Maybe we’ll see a neocortical mutation as we friend and follow many hundreds or thousands of people and attempt to manage ever larger numbers of “stable” relationships.

Abundance, the ‘net, and the open mind

I recently attended (and blogged and tweeted) Fiber Fete in Lafayette, Louisiana. One highlight of the Fete was David Weinberger’s talk, which closed out a day of presentations and panels about the evolution and implications of high-bandwidth networks. David had been asked to talk about “what we could do if we had ubiquitous, high speed, open, symmetric (i.e., roughly the same speed for uploading and downloading) connectivity.” As we sat together at lunch, he was telling me that he doesn’t really know how to answer that question.

What he did talk about was stimulating and, I think, important to consider: “an assumption of abundance…an abundance of information, links, people, etc.”

The abundance means we will fill up every space we can think of. We are creating plenums (plena?) of sociality, knowledge and ideas, and things (via online sensors). These plenums fill up our social, intellectual and creative spaces. The only thing I can compare them to in terms of what they allow is language itself.

What do they allow? Whatever we will invent. And the range of what we can invent within these plenums is enormous, at least so long as the Net isn’t for anything in particular. As soon as someone decides for us what the Net is “really” for, the range of what we can do with it becomes narrowed. That’s why we need the Net to stay open and undecided.

Read more at David’s site, “JOHO the Blog!” Ignore Richard Bennett’s comments. Think about what David is saying, and feel free to comment here, because I’d love to discuss it.

iPad for Breakfast

Yours truly with Bryan Person, iPad winner Charlie Nichols Browning, and Rob Quigley.
Yours truly with Bryan Person, iPad winner Charlie Nichols Browning, and Rob Quigley.

This morning (April 26, 2010), as part of the Social Media Breakfast series organized by Bryan Person and Maura Thomas, I led a discussion about the iPad. I don’t actually have an iPad myself, but I was eager to hear what the diverse SMB crowd would have to say about the impact and future of the device. Several who came had already bought iPads; we distributed them among the breakout sessions.

I framed the discussion by talking about the devices apparent strengths (light, mobile, easy to use) and limitations (hard to print, hard to interface with other systems, doesn’t have a built-in phone or camera). Then we had breakouts to discuss the iPad from various perspectives: what makes the iPad compelling; what is its impact on productivity, lifestyled, marketing, publishing, and social media; what can we expect from a world where we have connectivity like water – always on, everywhere. What had a great turnout, almost sixty people, and they were smart and vocal – so we had great conversations.

What were the conclusions? People felt that the iPad is more for lifestyle and entertainment, though there’s a potential for it to become a productivity tool. We heard that some hospitals are already incorporating it into their workflow, for instance.

One group felt that the “what the hell is that thing” confusion was part of what made the iPad compelling – people are drawn to it to try to figure it out.

They also felt that the iPad is driving a shift to new standards – platforms that start instantly, are light and mobile, incorporate touch technology, and are accessible and easy to use.

The iPad is not exactly great for productivity, though it can have an impact on efficiency. In business, it’s a great sales tool and communication tool, but it’s not a laptop or PC replacement. However it will allow sales professionals to demo anywhere, and gather information on the spot.

Where marketing is concerned, the iPad integrates both push and pull technologies and is a promising platform for ad-based content and services. There are already effective news apps. It’s also a great tool for engagement – many apps that run on the iPad and iPhone are social technologies.

The group that discussed social media was split regarding the impact of the iPad. They felt the biggest impact of the iPad would be in bringing in new social media adopters and spreading awareness of social media. Because it’s easy, it might help older people who are not digital natives adopt social media. It’s also great for multitasking. (We didn’t get into the discussion whether multitasking is evil.)

In publishing, there’s a split between specialized apps and browser-based experiences; the iPad facilitates both. The iPad might evolve as a textbook replacement. It will have an impact on organizing and editing information. The group agreed that information is more important than the platform for its delivery. There were questions about the future of print media as it becomes digital. The move from legacy to digital environments has meant lower revenues.

The iPad can be great for mobile professionals – physicians, for example, who will find the iPad even more useful as more health data is digitized and accessible in electronic health records.

The various limitations of the platform. – printing limitations, connectivity limitations, lack of USB, display interaces, cameras, and the lack of tethering were all limitations of the iPad, but none of them insurmountable. The iPad just wasn’t built to do everything. And it’s evolving.

Fiber Fete: Google’s fiber testbed

Minnie Ingersoll of Google at Fiber Fete talking about what Google is doing with it’s fiber testbed project.

What they want to do:
1) next generation applications.
2) Experiment with new and innovative ways to build out fiber networks
3) Work with “open access” networks

Not becoming a national ISP or cable tv provider. Google had suggested the FCC needed to make this kind of testbed, but realized the Commission had other focuses. Google realized this would be within their purview based on their mission statement.

Application review process for proposals from cities wanting the testbed project has begun. Over 1,100 communities applied. Evaluating based on speed and efficiency of deployment. Understanding how the community will benefit. Much will depend on the conversation they have with the communities as they learn more about their needs.

Working now on developing the offering. Openness – Is this a white label or wholesale service? What products and service partnerships are possible. Google will also develop its own high-bandwidth offerings.

May choose more than one community with very different characteristics.

Applications are full of civic pride. You learn what makes the various locations/communities unique.

Will announce services as soon as possible.

Leverage the enthusiasm – Google to create a web site to help communities connect with other resources. Don’t want to have cities feel excluded from getting higher-end broadband services.

What policies need to be in place to support broadband now?

Brough Turner asks about middle mile networks. Something Google looks at – where do they already have fiber? Sometimes communities farthest from the infrastructure, though, are the ones that would benefit most.

Bice Wilson: enthusiastic about leverage the enthusiasm concept. All the people in the room represent communities that are inventing this new cultural process. Google is helping drive the process. Are you planning to make this useful in that way (as a model)?

Google is looking for specific ways to keep the applicant communities talking to each other. Is it an email list? A forum? A wiki? Definitely looking to Open Source, create white papers and best practices from what they do so that others can benefit.

David Olsen from Portland: what type of testbed environment? Also thanks for what Google has done to raise consciousness of cities about significance of broadband.

Urban vs rural: not sure whether it will be 1, 2, 3, 4 communities. Might be in different communities, or neighborhoods or subsets of a community. Will probably be looking for more than one community, with differences. Probably a mix.

David Weinberger wonders how raw the data Google outputs about the project will be, and how immediate. Google hopes to satisfy with the amount of data, and immediacy. Google will be responsive to feedback, so people can let them know whether they’re providing enough info.

Marc Canter brings up political issues around municipalities providing pipes. Have they heard from AT&T and Comcast, etc.?

Google is definitely inviting the other providers to use their pipes. There’s plenty of room in the broadband space, and no one company has a monopoly on innovation. Discussions are ongoing about partnerships.

How open is open? What rules will there be?

Google will advocate policies around net neutrality, e.g. no content discrimination.

Garrett Conrad asks about leveraging Google’s apps vs apps the community might come up with?

The community aspect will be key, crucial. It would be wrong for Google to tell the community what they need… will be listening, but will also be prepared to offer guidance and applications.

Leslie Nulty asks what is the business structure concept that lies behind this? It’s not completely clear. Appears that Google intends to build, own, and operate these networks – become a monopoly provider. What are the checks and balances? Will Google become an unregulated monopoly?

Some will be the published, openness principles Google will be expect to be held to. Not a monopoly. Will offer reselling opportunities.

Canter: if you’re open, it’s not a monopoly.

The openness is of the service offering on top of our pipe. We’re not trying to force people into using Google apps.

Google does plan to build, own, and operate these networks in trial communities.

Nulty: price is the question for any community that might want to partner with Google.

Services will be competitively priced. Will negotiate with the municipalities on a contract that both think is fair. Google will be as transparent as they can be, and if there’s somethng they’re missing, let them know.

State regulations preventing broadband a barrier? Google wants to learn more about regulations and policies. Ask communities to explain regulatory barriers for their specific communities as part of RFI response.

Chris: Communities United for Broadband on Facebook.

Nancy Guerrera (sp?). Wants to know what it’s like working with local communities. Refers to previous project in San Francisco to set up muni wifi. Ended up building in Mountain View after discussions with SF didn’t work out. Google learned from this, though each community is different.

Will Google’s transparency extend to documenting issues/discussions with policy organizations?

Yes, if the press doesn’t document for us, we’ll do our best to document legal and regulatory barriers we encounter.

A thought about evolving social environments

I’ve been a member of the seminal online community, the WELL, for around two decades. I’ve been active on Facebook since it opened to non-students. Originally Facebook wasn’t conversational. Other former WELL members and I discussed how Facebook Groups didn’t seem to take off as conversational environments in quite the same way as the WELL’s conferences, many of which are still vibrant after 25 years. Facebook has changed since we had those discussions – now Wall posts and comments on Facebook are like topics and responses on the WELL. (We saw the same pattern in blogs with comments: someone posts a lead item, what we called the “zero post” on the WELL – a conversation starter. In blogs the emphasis was originally on publishing, then some blogs became more conversational, and posts followed by comments on those blogs were very much like topics within conferences on the WELL.)

One difference is that the WELL had a taxonomy: it was called a conferencing system, and was organized as conferences on subjects like Health, Media, Grateful Dead, Virtual Communities, Art, History, Design, etc. Topics were pretty free-ranging within the major subjects, but you knew where you would go to discuss a particular subject. On Facebook, there’s no organizing my subject. All kinds of conversations appear in Facebook’s news feed or activity stream – right now I see conversations about climate change and volcanoes, events, Texas politics, design, business, etc. – not organized in any particular way. A stream of comments some of which become conversations, many casual, some more active and compelling. This really seems to work, and the converations lately are not dissimilar from those I see on the WELL, despite structural differences between the WELL and Facebook.

I find myself drifting more and more into Facebook because there are real, sustained conversations there, unlike Twitter’s more drive-by posting – and because I don’t have to fiddle with a 140 character limit. Twitter feels very broadcast, compared to Facebook (or Wave, or other conversational systems). Not to diminish its importance – Twitter is a great place to share short bursts of information and links. But it’s less “social.”

This is me thinking aloud. Is there a business conclusion from all this?

I’ll close with this thought: I spoke to a group of Realtors last week, and told them not to expect miracles from social media. You’re not using social media because it’s somehow going to bring you more business than traditional media. You’re using it because it’s taking mindshare from traditional media. The audience is there – on the plus side, you can target more specifically the people who might be your customers or clients; on the minus side, they’re scattered over multiple platforms, you have to connect more directly than before, and they don’t often answer the door when salesmen come.

Times are changing: foraging, simplicity, Shirky-smart, etc.

Two of the best ideas I heard this week were curated or catalyzed by Clay Shirky.

One is the mathematical concept of the Lévy flight, which I already wrote about in my last post.

The other is in a link e-Patient Dave sent me. I ran across it again in a discussion of models for connectivity (“freedom to connect”). In a post called “The Collapse of Complex Business Models,” Clay discusses Joseph Tainter’s Collapse of Complex Societies, applying Tainter’s thinking to the web and digital media. Tainter says that societies that become increasingly sophisticated will tend to collapse, not despite their sophistication, but because of it.

Early on, the marginal value of this complexity is positive—each additional bit of complexity more than pays for itself in improved output—but over time, the law of diminishing returns reduces the marginal value, until it disappears completely. At this point, any additional complexity is pure cost.

Tainter’s thesis is that when society’s elite members add one layer of bureaucracy or demand one tribute too many, they end up extracting all the value from their environment it is possible to extract and then some.

The ‘and them some’ is what causes the trouble. Complex societies collapse because, when some stress comes, those societies have become too inflexible to respond. In retrospect, this can seem mystifying. Why didn’t these societies just re-tool in less complex ways? The answer Tainter gives is the simplest one: When societies fail to respond to reduced circumstances through orderly downsizing, it isn’t because they don’t want to, it’s because they can’t.

He then goes on to explain the evolution of complex and entrenched procedures within sophisticated, high quality media production, and how these are now trumped by the popularity of (commitment of mindshare to) simple, “good enough” media. Clay’s closing paragraph:

When ecosystems change and inflexible institutions collapse, their members disperse, abandoning old beliefs, trying new things, making their living in different ways than they used to. It’s easy to see the ways in which collapse to simplicity wrecks the glories of old. But there is one compensating advantage for the people who escape the old system: when the ecosystem stops rewarding complexity, it is the people who figure out how to work simply in the present, rather than the people who mastered the complexities of the past, who get to say what happens in the future.

Interesting to note that there are no comments on this post, only pingbacks (links to it by others). It’s an important, already influential piece.

The first point, about foraging, is that people don’t necessarily sustain adoption of something, even if they really really like it. In the early days of blogging, I made this point in talking about links and hits from blogrolls and RSS feeds. Someone finds your blog, they really like it, so they add the link to their news aggregator. Everytime the news aggregator updates, the link to your blog produces hits, but those hits are questionable, because a common behavior is to add an RSS feed, read it for a while if at all, then move on to something else. People don’t get the web delivered every morning as a newspaper, or monthly as a magazine. It’s not push, it’s pull, and they’re surfing based on criteria other than loyalty. We have to adjust our thinking accordingly.

The second point is that complexity reaches a point of diminishing return, costs escalate beyond what we’re willing to pay, and whole systems break as a result. With media, it’s not just that it’s simpler to make something that is compelling and gets mindshare. It’s that simpler access to “good enough” media (via the web) trumps more complex (or costly) access via movies or television. Consider the traffic in torrents of lower def but “good enough” copies of movies, television shows, record albums, etc. Or think of simpler paid access to slightly more lossy music/video via iTunes, or Hulu.

There’s more to talk about, like the social thing – we’re committing mindshare to online conversations that, before, we might have commmitted to passive consumption of television programming. But you get the drift – behaviors are changing online. And low-cost/free/good-enough is as entrenched in online culture as expensive/complex/high quality is entrenched in old media culture.

Times are changing. And I’m out of time, for the moment.