In looking at @prem_k’s
mindmap on social learning today, I spent a few minutes considering what events
can be measured relative to this topic. Unfortunately, I cannot embed the
diagram in this blog but please take a look at his
I came up with the following measurable elements and
hopefully most are self-explanatory. The mechanics of how you actually measure
these items can very from trivial counting exercises to some fairly complicated
metrics for mapping networks and measuring influence and sentiment. However, I
think most of it has been done before, perhaps just not applied specifically to
learning and pedagogy. So who’s up to that challenge?
I’m also just starting on Marcia Conner (@marciamarcia) and Tony
Bingham’s book, The
New Social Learning(ASTD & Berrett-Koehler, Sep 2010), and I
expect I’ll be learning a lot from it too.
-disemmination relative to origin
(generalized SN diagram)
-disemmination of topics across overall
network (generalized SN diagram)
-rate & velocity of
-Resharing/promoting (e.g. RT,
-Acknowledging/rating (e.g. +1,
-Relationship effects -
Friending/following/connecting, or unfollowing/negative externalities/outcomes
-Searching / search results (text,
tags, social searches)
If you are attending Enterprise2.0 conference next week in Boston, here
are some of the events that I will be at. I may session-hop because there is just too much to see. Our BlueIQ Social software adoption
will be all around the event, and even Gina Poole, our VP will be there.
8:30am – 4:15pm, Black Belt Practitioners Workshop
As I mentioned on twitter, my peer Jeanne Murray and I are
presenting a session at the Enterprise2.0
conference in Boston next week that describes an overall view of how we think e2.0 has
evolved in our organization. The focus here is not on the technologies
themselves but on the human capabilities, interests, and mindset as it has
evolved over time. It talks about what we used to think about social computing
and how that as changed or evolved with each stage.
This sort of view on evolution is not something that is
absolutely decisive. With a multinational organization such as ours, it does
not necessarily mean that every corner of the organization is at the same
level. The reality is that many locations are still at Stage 1 while others are
very well into the later stages. We use the stages to describe how some groups
have progressed in their thinking and approach to how they employ social
computing in their work.
I don’t plan to describe the entire presentation here but I
wanted to share the intention of our session and give an example of a stage. In
discussing the idea, Jeanne and I formulated five stages of this evolution:
-Stage 1 – Seeing a need for social
computing in business
-Stage 2 – Recognizing the business
uses and value
-Stage 3 – Bringing people together
into a common frame
-Stage 4 – Building better
-Stage 5 – Shifting the overall
perspective to a dynamic, agile mindset
For example, we entered Stage 2 when the mindset (in stage
1) progressed beyond thinking of social computing as something just for
personal entertainment or for kids into recognizing the business potential.
Within this stage, people have accepted there is a business need, but are still
unsure about how or where it applies in specific use.
The focus in stage 2 is to articulate value and use cases.
To do so, we needed to connect people’s expertise and collect stories of their
successful use cases. The glories of reaching this stage is that people are
starting to become more connected beyond the possibilities of their existing
location and organizational position; there are open networks and freer
exchange of ideas; and new social-enabled tasks are vetted simply the degree of
However, we also saw in this stage that the number of
repositories and ways of describing and sharing expertise were exploding. There
were multiple options for doing tasks in social tools, and people needed
guidance on which ones made most sense. Our wide diversity of tools simply
increased the many streams of information, and often randomness of information
Stage 2 has some people starting to connect, but a
recognition that for enterprise 2.0 to be valuable to the company itself (and
not just on an individual level), we need to consider how we get the larger
organization to do this all together (stage 3). This next transformation
requires looking beyond how individuals benefit from social computing, to how
groups and org units can work as a whole with this system.
Stage 3 then picks up from trying to unite the
infrastructure and tooling, as well as clarifying what to use when.
I hope to see some of you at Enterprise 2.0. Our
session is on Wednesday June 16th at 1-2pm (twitter hashtag #e2conf-34).
We will post the slides next week for others to see as well.
For our social computing metrics system, we have the ability
to see how people act on others contributions. For example, given one person’s
post, we can tell who is sharing, tagging and sometimes reading it, with
identities of all. This can tell us how much a person is impacting those around
them, who and how.
[Note: From an enterprise measurement viewpoint who the
individuals are is not important but you need their ID to key off other
demographics such as their job roles, geographic location, or organizational
location. This might be of interest to each person, but I’m looking at the
gestalt of the organization. Also this is information we are allowed to see per
This leads to several possibilities, given person X’s post.
The first set is diversity of reach:
a)What job roles are consuming their
b)Where in the organization are the
c)Given a single post how much
consumption is happening; and what’s the average per post
On the business level, this can tell us a lot about how
well the organization is connected, and if the expected views of what
job roles rely on others is actually occurring and how much. For example,
sales people working with their sales engineers or seeking domain knowledge
experts. It can show how far they
reach across the organization, and what other roles they connected to that
were not expected. For example, sales people in Slovenia working with
Researchers in Israel.
The second set may look at secondary effects. Given person X
posts, and person Y shares or tags, who is Person Z that eventually consumes it.
a)What job roles (persons’ Z) are
the end consumers
b)Where in the org they come from
c)How much and what’s the average.
d)Is there additional resharing or
This extends the first set by looking at eventual impact
from the source.
So far, I’ve just talked about one path of action from a
creator (source) to a consumer (sink).The next level is to look across many
actions on if there is bidirectional interaction happening between the roles.
This looks for ‘lasting’ relationships based on continued bidirectional
interaction. This can happen in immediate sequence (e.g., I post,
someone replies to me, I reply back, and so on); or it can be delayed
sequence of events (e.g., I post, someone reads/tags it, a week later they
send something else through a different social tool).
Here we are looking beyond immediate or unidirectional
consumption, towards the idea of if people are forming lasting relationships.
Notice for one that I didn’t even say that it was necessary
for people to friend each other before any of this happens. In fact, I think
that friending action while certainly making it obvious is highly variable.
Some people consider friending to identity those who they have lasting
relationships with, but others use it simply to keep track of people they are
watching rather than have any interaction with. The difference lies in the
bidirectional vs. unidirectional relationship there. In other cases, some folks
never actually friend others but certainly interact with them, therefore
indicating a relationship.
Why is this any different than SNA (social network analysis)
tools? Perhaps it’s the limitation of the SNA tools I have found in terms of
the level of demographics and granularity they can show. For example, some do
not show the demographics I need because they simply don’t contain that info,
or don’t understand which demographics are useful for business reasons.
In terms of granularity, most SNA tools can show the
structure for each person; i.e., the relationships and interactions between
person X and those around them, but I need info about the aggregate level of
everyone of one demographic (e.g. job category), and the relationships they
form. This is beyond most SNA tools today.
The biggest part is that it takes a lot of data collection
and number crunching over many, many people to even begin to analyze this. This is beyond System level metrics (how many users, how many documents), or object level (how much activity per person or object), but goes into the meta level that we would like to understand. This is also only one aspect of many others.
On the business side, the goal is to better understand the connections across our organization, and where we can try to focus energies to improve communications or encourage interaction. It is using information from social systems to create a smarter organization. For enterprise 2.0 to become a success, it is not just about empowering individuals to use social computing systems, but it is to make the organization itself function better.
When people think of developing leadership in social
environments, they often think of it in terms of a person developing their own skills
in leadership (1) versus how the group itself executes (2). These are two different things.
In particular, in my chapter on leadership models in Social Networking for Business, it is not focused on #1 individual leadership
skills, but rather on #2, how to consider what the right model is for
leadership in a given social experience. As said many times before, leadership
in a community experience is very different than that in individual social experiences
(e.g., your own blog, or profile page).
In a way, these models are much more “tactical” in the view
that they are what you might apply to one particular social environment
instance (e.g. the Durian-lovers community, Rawn Shah’s blog). These tactical
models may still run for years, and are not necessarily short-term—what we
often equate with tactical situations.
A strategic view, on the other hand, is from the eyes someone
or some team overseeing the Enterprise 2.0 ecosystem of all the social environment
instances. In many cases, they may be looking at thousands or millions of them
within the same organization. In the strategic view, you could consider how
many applications of each of the tactical leadership models exist. This gives
you an idea of how well the people across the organization are ‘skilled’--building their skills per #1 in online social environments--in
working in particular leadership models.
From an employee’s point of view, if you have never worked
in a workgroup of one particular leadership model, it takes a bit of time to
learn and understand how it works. It will require it anyway, because each
instance may have its own particular nuances and variances. However, my point
is that the employee understands the differences in working in different such
tactical leadership models, so they can contribute or lead the group more
These are the soft skills of leadership that we often
talk about, but here in terms of tangible concepts.
Furthermore, from the strategic view, this also shows that
you can have an effective Enterprise 2.0 collaborative system with high degrees
of autonomy, without needing to completely transform the structure of your
overall organization. What the employees are essentially agreeing on is that
within their many online collaborative instances, they will work as agreed
within each instance. The overall organization is still free to change and
transform, but it is possible to be both an open social collaborative organization;
yet still maintain the traditional structure, as long as both covenants allow
and support each other’s approaches and needs.
When you consider how relationship development is at the heart of social computing and enterprise 2.0, it should be natural to consider the career and leadership development of your employees in this context. This opens up new areas of thought into what it means to influence and lead others through an entirely digital medium rather than when you have a face-to-face leader. Inmy Forbes article (on Apr 16), I describe it as digital eminence to differentiate from one's leadership activities and capabilities through non-virtual environments--often amusingly referred to as "in real life", IRL for short).
The best way that I have found to describe it is in terms of how do people understand, appreciate and recognize your expertise, knowledge and skills through online interactions. This could be anywhere online, even email and chat, but it becomes more visible in social computing environments. I also like to separate this idea from personal brand building. While conceptually you are actually bringing out how you are different and significant from other people--even perhaps Seth Godin's notion of a linchpin in your organization--brand building also harks of self-promotion and ego-stroking. Digital eminence emphasizes what others think of you and your abilities, which may or may not have anything to do with self-promotion.
A second danger is in trying to quantify what is essentially a qualitative assessment. We should be very careful in considering number of followers, friends in your network, or quantity of posts as an indication of one's digital eminence. When you consider eminence as how you stand out, essentially a comparison versus the aggregate group of others in the same field, it may be seen as a ranking. Similarly, such quantity metrics also reinforce this ranking and rating approach. That raises lots of ethical questions when you look at it per individual.
That aside, the real question is what are you doing about sharing your expertise and skills with others? By doing so, you are building your digital eminence.
[Please note: I will replace this post with the recording and file links. ]
A quick note, I’ll be presenting an “Intro to Enterprise 2.0”
to the Univ of Arizona MIS 527 graduate class on Enterprise Information Systems
today. Since folks have asked, I’ve decided to open the presentation to others.
If you are interested in listening, this will be available by telephone and/or
webcast at the following sites.
Topic: Introduction to Enterprise 2.0
Audience: Graduate students, general interest
Start: 12:30pm Pacific Time, 3:30pm ET , Wednesday 4/15/10
End:2pm PT/5pm ET
Note: You can either dial into the audio conference
call or listen to it over the web from the Web conference (in addition to the
slides). The web conference will ask you which one you’re using so it can mute
the audio if necessary.
Please do go on mute (on your phone or press *6) unless you
have a comment, question.
In working recently on the topic of leadership and decision making processes in social environments, I thought I'd clarify something per my book. Quite often I see these decision-making methods split into simple categories--centralized versus marketplace (or distributed)--
when there is so much more. Additionally, the way how people work to produce results is not the same as who is involved in making the decisions.
One milling question from those who’ve looked closely
at my book, Social Networking for Business, is that leadership and decision-making processes seem to appear in two
different areas: the chapter 3 “Leadership in Social environments” and then
later again in the section “Describing the Form of Aggregation” in Chapter 4 on
Social Tasks. I should explain the key differences here.
Chapter 3 focuses on six different common leadership models:
Centralized, Centralized w/ Input, Delegated, Representative, Starfish and
Swarm. These models focus on whois allowed to participate
in the decision making process, set direction for the social group, and select
leaders. These range from those with very strongly centered to very distributed
The Aggregation methods on the other hand describe how
these decisions are made or this work executed: Independent,
Autonomous, Consensus, Deliberative, and Combative. These again are
alternatives to each other to create results.
Independent—Members work on the task separately, but the results are aggregated across all members
Autonomous—Members work on the task separately of each other, and their results are distinctly visible to other members as separate work.
Consensus—A group of members works directly together on the task with the intent to deliver an overall collective result, even if it’s not unanimous or convergent.
Deliberative—A group of members works directly together without the intent or necessity of coming to a consensus on a single result.
Combative—Members must compete against each other to derive the best result from the group, denying other choices.
Certain pairs are more likely to occur: e.g., a swarm is
likely to use the Independent aggregation where only the combined results (voting)
across many members result in a single value. A delegated model is likely to
have autonomous decisions spread across the different domains delegated across
The moral here:
Set the right expectations -- Be clear not only about who
can make the decisions, but also for those who can do so, how they can make
A key takeaway from this report that I find quite revealing: it contradicts the common belief that all communities develop into a 90-9-1 rule (90% lurkers, 9% contributors, 1% authors). Per the report: “As the community management discipline matures, there is increasing understanding of where certain rules of thumb like this apply and where they do not.” I've once looked at the origins of this meme, and other than the Pareto principle, in online communities it dates back to specific posts in a Usenet newsgroup around the early 1990s. I need to find that link again. We now think of much more than just contributors and lurkers since there are many other ways to contribute as well which are not so obvious. That is a distinguishing mark that elevates the level of insight that this report brings above others.
What thrills me is that of the eight competency areas within, only on area focuses on tools. The majority of the focus lies in business principles: strategy, leadership, culture, policies, etc. The general media and blogosphere is always fascinated with new tools and toys but the real value is in understanding the almost unchanging business principles many of which are outlined in the list of competences. Each of the sections on these competencies specifically identifies lessons learned directly from the real life experience of members of The Community Roundtable.
I've talked before about the value that community managers bring to organizations, so I have to point out a specific section the role and issues of Community Management which can help current organizations understand the heavy demands of this role. Perhaps, with this insight, more organizations will take to heart that Community Management is not a part time, or a junior role in the organization. It takes a lot of people and relationship skills that develop with experience, and in doing so creates the same qualities we ask of our business leaders.
For folks who’ve asked me about social computing and the
retail industry, I’d like to describe ideas in use. Some of you may already be
familiar with these.
First of all, there’s the “w00t” idea, most common in the US
as the site www.woot.com and even featured
in campaigns with American Express and others. It’s fairly simple, every day
they list a limited quantity of a single product (at seemingly random) at a
good deal of discount. Its success depends on mixing in very popular items with
some of the ordinary ones at many different price points, spread across a wide
range of product categories.
The social element here is in competition to get
one which often heats up considerable. Folks have even created bots or software
applications to beat others to the purchase. To spur this competition on, there
is constantly updated “sales snapshots” of the purchase experience for that
item: a map of the US where it’s being purchased the most, sales per hour, the
number of times the purchaser has bought from the site before, how many the
bought, etc. Finally, the discussion thread often gives social input or
feedback to what others think of the product. Other companies have tried this,
for example, I recall seeing it on American Express shopping as Deal of the Day
where they had a Honda Civic Hybrid as the deal for almost 60% of the sale
The key element is the competition, limited quantity and
thus exclusivity of the items of the site. All the social input exists to feed
the competitive basis unlike other online retail sites, where this is not at
all emphasized. Rather they take the stance that there is always some quantity
available. However, the competitive element of woot combined with a surprise in
random but in-demand items, is what turns the social elements into a game-like
structure, and most importantly: bring people back to the site. This method
isn’t new by any means, but the online environment makes it easier to spread
the word and increase the likelihood of sales. The social experience model here
is a mass collaboration with swarm leadership and combative aggregation. (if
this doesn’t make sense to you, please read my book).
Unconfirmed, but did the jargon term “w00t” originate from
“iwoot” = “I want one of those”? See http://www.iwantoneofthose.comwhich is not this above model, and closer to what
is now “traditional” online retail, purchasing with ratings and comments. Or is
it a derivative, if I remember right, of the “woof, woof” sound made popular
back in the 1990s by the Arsenio Hall show.
is another form of social computing applied to coupons for services within your
city (again mostly in the US). Essentially, it takes the woot model to a new
level, requiring people to invite enough members to qualify for the coupon. The
time limit is again one day only, and it is specific to a city. So, if a user
really likes the coupon promotion, they may need to try to get their friends or
others of like interest to also vote for the promotion, or just wait to see if enough
people from their city vote, before they can even take advantage of it.
Here, the social experience is not entirely a mass
collaboration like woot, because people do not necessarily work entirely
independent of each other. It allows two choices: you can bring your friends as
a small community to vote and get the coupon, or you can vote and hope that
others join in. In other words, it’s a hybrid of a mass collaboration and a
community. The leadership effects are also swarm-like, with no single person in
charge and each person making their own choices (typically to vote positively
for the item). However, this is not combative but consensus aggregation.
The core competency here is in terms of facilitating relationships and communications between different parties. There are in fact many different types of interactions that this role takes on. In as such, this means they participate as a part of many different role-interaction patterns. This is significant since when such patterns are frequent and repeated, it becomes almost transactional, and therefore measurable. If you need the example of a more common role-interaction pattern: think of a support call from initial contact to completion after a solution or resolution has been reached and the customer is verified as satisfied. Each such complete interaction has a measurable value; or you could also measure it in terms of cost or time it took to conduct that interaction end-to-end. Finally, you could also measure it in terms of quantity of those interactions actually reaching completion rather than partial or incomplete resolutions (likely meaning an unhappy customer left hanging).
The RI patterns for Community managers are of a different sort but the following tables give some suggestions of the kinds of patterns they could participate in.
Table 9.1 -- The Value of Community Managers
Improving relationships with members by providing a human face
to an organization or a large social group
Bringing the value of their own relationships and contact
networks within the organization
Arbitrating conflicts between members, or between the member and the
Coordinating member projects and activities
Serving as a repository of situational knowledge about the
organization, the members, or the content
To the sponsoring organization
Serving as an organizational spokesperson to the membership
Providing a view into the climate
of the members about the topic or purpose (the business climate within the
enterprise, across business partners, or across the industry)
Housing a repository of situational
knowledge about members, the content, or the topic
Encouraging and monitoring
member involvement and participation in the topics that
interest the sponsor
members might have with the organization
describing value or outcomes of the social group
and potential for hires or rehires
Table 9.2 Supporting Customers or Partners
Customers or business partners (public-facing, cross-boundary, third-party)
Marketing or sales
Increasing the number of touches with customers
Identifying customer evangelists and activists
Discovering industry trends and customer interests
Acting as marketing
liaisons to customers
Guiding marketing on
appropriate messaging or tactics
Product development and delivery
Assisting in gathering product requirements from audience
Conducting market research with customers
Identifying competitor activity or offerings
Conducting design tests and product beta-testing
Delivering products to customers online
Customer relations or product support
Providing a human
interface to the organization or social group
Serving as a “finger on the pulse” of audience concerns
Helping partners locate internal representatives or departments
Helping customers find appropriate support resources
Identifying troubled or
There's another table on their roles within the enterprise supporting employee and organizational interactions.
I should be getting some early copies of my new book, Social Networking for Business
(Wharton School Press, 2010) straight from the printer/binder just
before Lotusphere. I'm planning on bringing some to hand out at the
event either during lunch--our BlueIQ Social Software Adoption team
will be hosting two tables with signs, so come by and talk to us. We'll
be chatting on just about anything around adoption, how we do it in
IBM, and what you can do with social computing.
If you haven't seen it yet, it is available at, Amazon, Barnes&Nobles or other booksellers around the 24-29th this month. Kindle versions should be out a few days earlier.
I learned the other day from a friend that taggers—the spray
paint kind, not the online variety—are often quite predictable. If you look at
a map of the locations where they tag, you’ll often found a common radial
pattern of increasing density of their tags. The closer to the center of that
circle is the general vicinity or even the very house that the tagger lives in.
Applying some social computing to the idea, I could see a
useful mass collaboration social experience, where the task is to allow anyone
to submit smartphone photos with GPS locations of where they see a tag. You can
then plot this on a geo-map and over time create a result of frequency of occurrence.
Social sites like Brightkite and Foursquare that let you share your location
prove that it’s quite possible to create such a map.
So, there’s a possible project that can apply to any location
really, with the help of any willing citizens. There are some practical issues:
identifying the actual tag signs from different taggers, collecting enough data
for useful information, and cooperating with the police to utilize this
information. However, these are not insurmountable and it would help the community
A thought I had a few weeks ago on a measurable value outcome
of switching to social computing reflects a common situation in our company: mailing
large files around. Simply said, many enterprise mail systems such as Lotus
Notes allow the central administrator to set a limit on attached file sizes.
By imposing a limit around say 4MB, and redirecting people
to use Lotus Connections Files to share large documents, you save: a) network bandwidth
usage; and b) storage of multiple copies on local drives and on mail servers.
LC Files on the other hand adds lots of other benefits like
re-sharing without re-forwarding the files, comments w/o re-forwarding, and lookups
on who it is shared with (or not).
This activity may not be practically measurable per person when
you have many thousands of people. On the other hand you can measure the quantity
of documents and their file sizes, on the email system versus LC. What it comes
down is a known (or knowable) IT cost factor of $ per MB. IT departments could
show the cost savings directly due to reduced infrastructure use and resource
What it does change is user behavior. The first necessary
element is a tool that can automatically redirect where the document is stored
(a link to it on LC Files) rather than the email. The second part is
enforcement through the file size limit. You really need the redirector to work
smoothly so people do not see this as a burdensome task.
So in a direct way, you have a measurable outcome related to
hard $ amounts. This kind of alternative mechanism works easily for files, and
is still just a basic step in moving towards enterprise social computing. Slowly,
What I'd be additionally interested in is looking at the trends of how re-sharing occurs after such a switch. It's pretty common to see people re-forwarding a file to others but this allows a better alternative. In a limited sense, it can also improve security: if the user does not allow publicly share a document, it may be limited to only those they intend. Of course, there are always alternatives and other mailers but it's good manners to keep to their request.
It seems so old
school to try to classify social computing metrics but I keep getting the same requests from various internal teams, who are sometimes not familiar with some of the metrics, don't understand
them, or simply use other metrics better suited to Web sites rather
than social sites. A second goal is to evaluate the qualities of
these metrics to determine if they are useful (e.g. using the SMART
analysis approach). A third is to see the relationship of the metrics
to each other—whether there are dependencies, or if some metrics
are more meaningful when reported alongside or compared with others.
To give an idea,
while it's considered outdated by others, some still look for
Pageviews, and Unique Visitors--classic web metrics better suited to
measure how people visit pages, than interaction from social
environments. Similarly, "Interaction" itself becomes
another stopping point for metrics. These are the metrics most
commonly recorded by social software tools: number of posts, the
number of downloads, the number of connection invites, etc.
In working with
our social computing researchers we're also looking at Network Effect
metrics such as the Topics (what people discuss) that come out of the
system, or the ratio of consumption to a person's content
such as marketing teams have an emphasis on Engagement metrics,
considering how much a person is becoming involved in a social
environment, an event, a marketing offering, or other engagements.
Other engagement metrics aren't specific to marketing only. For
example, thought-leadership metrics include the ratings on content
someone has submitted, or how often they have been quoted or
retweeted by others. A more complex one is to determine the Impact a
person has on their target audience.
To go further
along on marketing metrics, these can even build up towards the sales
pipeline—how many interested individuals are there, are they
potential sales leads, have they actually asked for sales info, has
that lead been validated, and then closed. Joe Cothrel, Chief Community Officer of Lithium
suggested similar ideas in an article for Strategy+Leadership magazine back in 2000, on conversion rate from a
visitor to a sale, as applied to social environments.
and sales, there are other indicators that relate to business value
metrics. Some suggestions in a recent email exchange with Dr. Walter
Carl, Chief Researcher of ChatThreads and a member of WOMMA's board on metrics include
cost reduction (using this tool to communicate is a lower cost than
other existing ways), accelerating adoption of any business
philosophies, values or company directives, processes that minimize
lost revenue, etc.
Lots of Metrics,
but what are their qualities?
So what should be
obvious is that there are lots of metrics, categories, subclasses,
variations, and inter-relations that different organizations or even
different teams within the same organization utilize. What
constitutes business metrics and delivered value for one team may not
even be relevant to another. So I'm still surprised when people ask
for a generic ROI methodology.
All the same, the
next step is to look at the qualities of these metrics. I mentioned
the SMART acronym earlier which are basic questions if a given metric
type or unit is:
(specific and targeted to an area of measurement),
data point that can be captured and collected),
(robust data that can be analyzed and utilized by a stakeholder),
realistic, meaningful and consistent measurement),
(current and possible to collect in good time).
all these qualities, there will likely be a problem with either
collecting the data in a way that is meaningful and available in time
for use in a business.
There are other
qualities that I think are important to consider as well:
it scalable in quantity? Can you capture larger and larger volumes
of data or does it become computationally intractable
it apply across social environments of the same type? Is the metric
relevant to a single social environment, or can it apply to many
environments of the same structure (e.g., a discussion forum)?
scalable and still meaningful across different social environments
(e.g. A blog and a forum)?
Does it drive
behavior? Does it encourage that person or other people to interact
credible? Is it a measure that is accepted by other teams,
organizations or even industry-wide?
significant as a performance and/or a diagnostic metric? Performance
metrics are useful for comparisons across like types. Diagnostic
metrics help determine the state of the system.
Is it a
quality metric? That is, counting it does not really describe the
value contained within it, so you need a secondary way of looking at
it helpful to look at it across different demographics? This is very
insightful in some metrics, and just not necessary in others.
I'm sure there are
more relevant qualities, but this is already quite a lot to think
about. These qualities can help decide which metrics are the most
useful or what they can tell us, independently of the others.
is to look at which metrics should be reported alongside each other,
or which ones depend on others directly or indirectly. That's where
things start to get real interesting and much more subjective.
No conclusion here
because this is on-going work trying to map out all these variants of
metrics, but here's to hoping it inspires others to think and work
along these lines.
Per my previous note, I mentioned that we have 400,000
people collaborating across 170 countries in IBM.
That raises a great question of what does it mean to have 400,000 people
collaborating? Are they all in one massive social network connected to each
other? Are they participating in the same spaces? Are the contributing to each
To give an idea, first we need to look at the state of
social computing in IBM. First, there is not
one but at least 32 different social applications each of which can have
hundreds of thousands of unique users, and tens of thousands of instances
(e.g., separate wikis, individual blogs, etc.)
By another count, there are over 200 applications--it varies based on what different folks consider as a "social application".
For example, in rough numbers of some of the tools
200k replies (aging removes some)
Dogear /social bookmarking
Beehive (social net)
Cattail (social file sharing)
This is just a subset and unofficial list of these services.
There are other tools for enterprise wide social searching, social
brainstorming, instant messaging, tweeting, podcast/videocast sharing, social
profiles, and analysis tools. Some of these other tools are used by 100% of
employees particularly instant messaging and out Bluepages (profiles) systems.
Others have even more people because non-employees such as business partners,
customers, and even suppliers have access to them.
People generally use them as follows:
across the enterprise: e.g a blogger
team spaces: departments and hierarchical teams
spaces: across multiple departments
group spaces: e.g., someone creates a Lotus Connections Activity and
So the groupings vary significantly, and a number individuals
do use many of these tools for different reasons, but unique users still reach
across the company.
The types of activities or projects in these spaces are just
as varied as the job roles, products and markets. Think of it, just in terms of
products alone, I think we have over 5000 distinctly, different ones (and not
just variations); some are very complex (imagine working on the DB2 database), and others are smaller. That still doesn’t include the many thousands of customer projects
people are working on at any one time. So in general there aren't any common scopes or scales for
what people work and interact on.
The general philosophy that creates this mix is that as a
company we encourage an internal free-market environment to allow many tools to
appear and compete with each other. This helps the best ideas to emerge out of
new social experiments and methods. While someone has to pay for the
environments, this is up to each social app project to figure out how to fund. There
are official tools that are universally supported, but there are also other research
and experimental projects—even Beehive as a research project easily includes over
We also do not police these activities. People are talking
about their non-work activities, but that is a natural outcome of social
interaction. As long as people are not breaking their business conduct and the
social computing guidelines, they are okay to use it how they like.
This kind of quantitative information really doesn’t show how
people are collaborating just where. Rather our BlueIQ team collects
success stories, especially recreatable and reuseable scenarios, from
individuals illustrating how they are productively working together in these
In general, it is complex to say how people are
collaborating, but safe to say that they are collaborating widely in the
social environments in IBM.
The book has progressed and transformed significantly over the past year. I've probably rewritten the contents three to four times already, either shifting large sections to bring related ideas together, towards a business focus (requiring less prior technical knowledge), and in a more cohesive concept.
The draft chapters all go up onto the Roughcuts section of Safari Books. What's confusing is that the latest information is in there but only to registered members, and the free information you see up front is several drafts old. So, I'm including the ToC here:
MIT Emeritus Professor, Edgar Schein's classic book on Organizational Culture and Leadership describeshow companies undergo differentiation at a cultural level in "mid-life"which has given views to some classic opinions of how IT folks viewculture versus how executives, sales and other folks (termed Operators)see it. This may seem a little dated in some ways but the core thoughtsstill pervade many companies (even us).
One classic argumentin this vein is the different views of "should information becontrolled" discussion which comes up so frequently in social computingand media.
I thought it might be interesting to see a third-viewin terms of how social computing aficionados view culture. Taking adirect copy from Schein's book (pg 275-277) are the first two columns,albeit sorted slightly. The third is my comparsion in terms of socialcomputing.
Please feel free to add your views.
Operator & Executive culture
Social Computing culture
Information can be packaged into bits and transmitted electronically
Information relevant to operations must include face-to-face human contact in order to be accurately understood.
People can relate to both information and other people through electronic means
More Information is always better than less.
The more quantifiable Information is the better.
Information must be extracted from raw data and will be meaningful only in particular context that is itself perpetually changing.
Meaning derives only from complex patterns.
More information is helpful but it should be interpreted through each individual’s view and understanding of context
Technology leads and people should adapt.
People can and should learn the language and methods of IT
Technology should adapt to people and be user friendly
Technology should follow how people behave, and adapt to their language and methods.
Technology should be assistive.
Management will give up hierarchy if IT provides better coordination mechanisms
Hierarchy is intrinsic to human systems and a necessary coordination mechanism
The costs associated with speed may not be worth it
We live in a fast-paced, highly interrelated, and mesh world where hierarchical access is not always the most effective way to distribute information.
Social computing can provide better ways for different ways to organize coordination, including hierarchical structure.
The more fully connected an organization is, the better it will perform
Too much connectivity produces information overload
Social computing can assist maintaining relationships and connectivity, and managing information sources
People will use information responsibly and appropriately
Control of information is a necessary management tool and the only way of maintaining power and status
Give people a chance to demonstrate responsibility.
Show them helpful methods but do not limit their behaviors
Paper can be replaced by electronically stored information
The ability to see and manipulate paper is intrinsic to many kinds of tasks
Mostly agree with IT culture
Information can be captured and frozen in time
Agree with IT culture
The more information you have the more you need
Software can help filter information to what you need.
You may have already heard about Facebook's new look as they change the social experience for users. While still focused on the Individual as the center of the experience, they are adding more capabilities. In particular, I'm amused that they are finally catching onto the idea of multiple tabs each per application, although they have not moved to free form tabs like developerWorks Spaces, netvibes and other sites. Separating the app to a different tab helps to create shorter, cleaner front pages, by compartmentalizing and creating subtopics. However, it is better if it is not limited to a single application; after all you might have several tools and widgets to focus around the same topic.
PS: I'm trying out AddThis, a service that lets users redistribute any URL to over 30 other social sites, saving me the trouble of adding links to digg, del.icio.us, etc. manually.
If you have not come across it before, web2logo.com provides an extensive listing of companies in the social computing and Web 2 space. There seems to be approximately 1000 companies listed there in one form or another. Some logos are repeated (e.g. Google in different versions) but that's rare. Clicking on a logo will give a description from Web2list, site traffic data from Alexa, and current Technorati-tracked blog activity for each of them. It's hard to say if this data is accurate but it does give an idea of which ones are doing decent enough to watch.
Wow I haven't really posted in here for a while. Time flies when you are having fun.
Lately I've been working on a survey of attitudes and behavior towards social software inside IBM among the sales people. It's part of my current assignment. I'm also putting a lot of my spare focus on my upcoming book. In talking to random folks at the Community 2.0 (tweets) and Online Community Business Forum, there seems to some exasperation on needing more structure around what constitutes community strategy, even among the people who aren't new on it. This is good news, since that is likely to get more people thinking about what to do about it.
I'm also on many different tools these days. Most of my activities outside IBM these days are either on Twitter or my dW space where it's either easier to just write a post, or post mixed media content.
One of the more anticipated massively multiplayer online games coming up later this year (and anticipated all last year) is the Age of Conan. Aside from the game's theme and storyline, one of the interesting aspects here is the ability to create a virtual army of folks numbering in the hundreds.
This isn't a new idea per se. There have been MMOGs that allow for team efforts all the way back to the days of text-based MUDs, but the 3D worlds of today make it increasingly more complex with the addition of many types of tools, weapons, etc. What AoC also allows are full scale sieges of town and cities by an army. This kind of planning takes a whole new level of thinking.
The base level ideas focus on organizing a team of folks to achieve some stated goal. In most cases these days, this is something a guild will undertake with its members; however, it doesn't need to be a pre-organized/preset community, and many such quest efforts can take on an ad hoc group.
The next stage beyond just gathering folks is understanding the roles and skills of the members. Often there is a leader who has experience in the matter on what skills are necessary and where to place people (in the environment).
Usually this is event-based, that is, focused during a specific amount of time (rather than a long-term activity). So another step is to make sure the key folk needed arrive at the meeting point, along with their tools. If they don't the leader(s) need to readjust the assignments and formations.
During the execution of the quest, there may be preamble actions to take before they get into the mix of it; in MMOGs, this could be casting spells, donning specific armor, etc. Then there may also be real-world things to set up: a comfortable seat for long activities, water/super-caffeinated products, going to the restroom, quiet environment, etc.
As they enter the melee, the direction becomes even harder since there is so much going on. Modern MMOGs allow special heads-up displays showing status information, communications channels, and more, with different HUDs possible for different roles. It's not just keeping up with the action in the melee itself, but also keeping an eye on the HUDs to make sure you are in sync.
The activity can rage on for hours, and the stress impacts everyone. Everything from friendly fire, kill steals, random shots, hard choices, and more. The commitment here is not just in terms of mental stress and duress, but also in terms of ability to keep focus and in sync with the overall plan. In other words, the moment to moment stressful and dangerous action makes it feel real to many. The high level of risk is what helps to develop the level of commitment amongst players to the game, and to each other.
The aftermath or outcome also has consequences. As a fried said, most guilds fall apart because of arguments when dividing the winnings/loot. Everyone has sacrifices per their character, and many are emotionally connected to their character on a deep level. A catastrophic loss of equipment or the character takes it toll as a long-term effect; I would daresay on a level proportional to how long the person has been involved.
In a real-world military system, leaders assume that teamwork is a given. They never had to face the idea of a "democratically-organized" army as in an MMOG. That is a much harder proposal in terms of setting up teamwork.
Money magazine is reporting that Video Gaming will be a "welcome event" at the Beijing Olympics. Apparently the Chinese government recognizes it as an official sport alongside other ones that require agility or dexterity (like soccer), although the Olympic committee has not accepted it as yet.
This isn't like the World Cyber Games (in Germany in 2008) which takes things much more seriously as a sport, but it is a start. After all if Bridge counts as a "sport"...
There are several different ways of looking at what to measure and how to measure benefit or value in social software systems.
First, who receives the benefit from the system, and how do you measure their benefit:
the individual view - the question: "How do I as an individual benefit from the social systems and networks I am involved in?"
the comparable individual view - If I can measure how each person benefits, can we compare that benefit between the persons? This isn't always so, because the value to an individual may be specific to themselves, and not quantifiable in a universal manner
the organizational view - How does the organization benefit from social software (at different levels of social system, teams, departments, units, etc.)? Is this organizational view a composite of the comparable individual view or is it different?
the comparable organizational view - Just like the individual view, there may be a comparable organizational view as well. These again rely on establishing a comparable basis of measurement of one organization versus another.
Then there is a difference between the value of the social network as a structure, versus the content in that network:
the structural view - How do you measure value of the structure of contacts, parterships, collaborations, connections, networks, and other connectivity-based views of the social systems you are involved in?
the content or knowledge view - How do you measure the value of knowledge or content from that network? Can they be packaged as assets specifically?
Aside from the value of structure or content as different forms of assets, how do you measure goal-achievement from the network.
These are just my own ruminations. I believe that there are some ways to develop or gather metrics of some of these, but it may be a while before we can agree on how to measure all aspects of these. Before thinking about how to formalize this, you should take a look at these ideas of how to carefully define a measurement process by Peter Andrews, part of the Senior Consulting Faculty for the IBM Executive Business Institute. These are the brainiacs that think about the "thing behind the thing" (to paraphrase the classic statement from many a mobster movie): how to define or measure abstract concepts like innovation, strategy and more.