Are you one of us few, lucky people who attempt to keep track of the health of one or more communities?
Have you written any tools, processes, or other content/code that helps you with this? (For example, our team wrote and uses EKG for mailing list analysis.)
Are you looking for a commons to share ideas, code, content, and so forth?
We are looking for that too. We see a common problem space, are tired of working in isolation, and think there should be a working special interest group on this topic. A group made up of all the other individuals and teams currently working on this in isolation.
If it doesn’t exist, we want to start a new working group for this. Maybe you’d like to be involved? Comment on this blog post so I can include you in what we find out or make happen.
We see other groups who are working in this problem space … apparently in isolation from each other?
- Mozilla’s massive metrics project
- Meego metrics
- Ubuntu metrics
- Debian team quality tracking
- Simon Phipps’ open-by-rule benchmark
- Tom Callaways’s fail-o-meter
- Open Governance Index
- Redmonk
- 451 CAOS Theory
- And many others, I’m sure …
(If any of the above are not isolated but are part of a commons movement, can you show us where the commons is? That is, beyond their own mailing lists.)
So each of the above is a unique community or analyzer with a unique situation and needs. But certainly there are common areas where we can help each other? Common tools even if the analyses are different in the end? Common processes to share, even if your implementation is closed-source-in-house?
I just spoke with the QTM group at UPenn’s PRECISE Center who are using open source repositories for reputation analysis, working from a tool originally written to track wiki article author/editor quality. I want to invite them to either join a working group with us, or join in starting a new one.
So what’s going on out there?
(Updated with improved information and better links about the UPenn crew.)
The Libresoft research group based out of University Rey Juan Carlos in Madrid, Spain has come up with some interesting tools (mlstats in particular) that others are using, particularly the Meego folks (who have the most comprehensive collection of running open source tools for community stats gathering I’ve seen). Dawn and Dave gave a nice talk at OSCON 2011 about the toolset they’re using for Meego; I wouldn’t be surprised to stumble across other academic groups trying to do the same thing. Alas, I can’t read Spanish, so my ability to investigate Libresoft’s work (only some of it has been translated to English) is limited.
Definitely keep me in the loop – I have been wracking my brain for 6 months on how to best represent my community in metrics
So many interesting and relevant projects…
If we (researcher at Penn) can be referred as:
the QTM group (http://rtg.cis.upenn.edu/qtm/index.php3) at UPenn’s PRECISE Center (http://precise.seas.upenn.edu/)
that would be more useful to others who want to know our background.
Thanks,
Insup
I’m interested,
Andreas
Hi,
I’m mentoring the GSoC project for team metrics inside Debian. My initial approach inside Debian was just to study the mailing list activities as it is obviosely done in EKG (just testing this currently) but we found out that this could be extended to code commits, package uploads and probably other measures.
You might like to watch the video of our BOF at DebConf which is available from here:
http://people.debian.org/~tille/talks/20110729-gsoc-teammetrics/
I would love to cooperate with other groups / teams doing similar investigations.
Kind regards
Andreas.
[…] Karsten Wade called for the formation of a working group on community metrics. Permalink | Technorati Links | Bookmark on […]
[…] Working group on community metrics Are you one of us few, lucky people who attempt to keep track of the health of one or more communities? […]
I’m interested in working on this. I just got out of an open source job and joined academia, where I hope to stay with the movement. metrics on communities would be huge.
Our team would be very interested in contributing to this working group on community metrics. In fact, we’ve been utilizing a homegrown metrics based evaluation tool for years to help us evaluate the health and vitality of open source communities. We have it available for release under the Creative Commons Attribution-ShareAlike 3.0 Unported License. However, its format is currently a spreadsheet; so there really is no public open source repository (e.g. GitHub, SourceForge.net, Google Code, etc.) available that will take spreadsheets. Our future plans are to create a web application off of it; but we simply don’t have the bandwidth at present to execute such work.