Metrics after move from Yammer

%3CLINGO-SUB%20id%3D%22lingo-sub-29308%22%20slang%3D%22en-US%22%3EMetrics%20after%20move%20from%20Yammer%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-29308%22%20slang%3D%22en-US%22%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F12%22%20target%3D%22_blank%22%3E%40Anna%20Chu%3C%2FA%3E%26nbsp%3BIt%20has%20been%20a%20few%20months%20since%20the%20ill-conceived%20move%20from%20Yammer.%20How%20many%20people%20are%20using%20this%20new%20community%20as%20a%20result%20of%20search%20they%20performed%20on%20the%20public%20internet%3F%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EWhat%20other%20metrics%20have%20been%20gathered%20to%20document%20the%20success%20(or%20lack%20thereof)%20of%20the%20move%3F%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-29308%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3ECommunity%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-32098%22%20slang%3D%22en-US%22%3ERe%3A%20Metrics%20after%20move%20from%20Yammer%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-32098%22%20slang%3D%22en-US%22%3E%3CP%3EJust%20found%20that%20badges%20metric.%20Yes%2C%20that's%20not%20a%20good%20to%20compare%2C%20but%20good%20enough%20to%20see%20the%20stats.%20From%20about%2030K%20members%3C%2FP%3E%3CP%3E-%20only%20~1.7K%20started%20at%20least%20one%20conversation%26nbsp%3Band%20~3.2K%20make%20at%20least%20one%20reply.%20Other%20more%20than%26nbsp%3B25K%20posted%20nothing.%3C%2FP%3E%3CP%3E-%20if%20to%20calculate%20bit%20more%20active%20people%20170%20(not%20K%2C%20just%20170)%20started%20at%20least%205%20conversations%20and%20~550%20posted%205%20and%20more%20replies.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThat's%20if%20badges%20stats%20is%20correct%2C%20this%20site%20doesn't%20like%20arithmetic%26nbsp%3B-%20i%20often%20see%20negative%20number%20of%20conversations%26nbsp%3Bon%20community%20tile%2C%20etc.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EAnd%20if%20take%20Lana's%20figures%3C%2FP%3E%3CP%3E-%200.18%20conversations%2Fmember%20and%201%2C729%20conversations%2Fmonth%20for%20this%20community%3C%2FP%3E%3CP%3E%3CSPAN%3E-%207.0%20conversations%2Fmember%20and%2018%2C667%20conversations%2Fmonth%20for%26nbsp%3BO365%20network%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%3ELet%20compare%20in%2027%20months...%3C%2FSPAN%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-29431%22%20slang%3D%22en-US%22%3ERe%3A%20Metrics%20after%20move%20from%20Yammer%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-29431%22%20slang%3D%22en-US%22%3E%3CP%3EI%20will%20be%20a%20lot%20more%20satisfied%20with%20this%20community%20when%20the%20UI%20stops%20becoming%20a%20huge%20annoyance.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThe%20Yamjams%20used%20to%20be%20exciting%20and%20fun%2C%20the%20AMAs%20yesterday%20were%20incredibly%20difficult%20to%20follow%20and%20participate%20in.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThe%20fact%20that%20I%20can't%20see%20Unread%20content%20is%20BEYOND%20frustrating%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-29430%22%20slang%3D%22en-US%22%3ERe%3A%20Metrics%20after%20move%20from%20Yammer%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-29430%22%20slang%3D%22en-US%22%3E%3CP%3EHey%20Dean%2C%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EI%20am%20happy%20to%20share%20a%20few%20numbers%2C%20but%20first%20I'd%20like%20to%20note%20that%20you%20are%20missing%20a%20VERY%20large%20piece%20of%20the%20puzzle%20when%20thinking%20about%20why%20we%20moved%20and%20measuring%20the%20success%20of%20our%20move.%20The%20ability%20to%20lurk%20and%20get%20content%20out%20from%20behind%20the%20Yammer%20sign%20on%20wall%20is%20clearly%20larger%20than%20just%20being%20indexable.%20Also%2C%20Yammer%20doesn't%20offer%20the%20customizations%20that%20we%20need%20as%20a%20marketing%20community%20and%20platform.%20It%20also%20didn't%20allow%20for%20a%20community%20structure%2C%20since%20there%20are%20no%20sub-groups%20or%20hierarchy.%20The%20list%20goes%20on%20and%20on%2C%20but%20that%2090k%20number%20is%20not%20reflective%20of%20the%20actual%20engaged%20users%20on%20the%20community.%20Traffic%2C%20usage%2C%20consumption%2C%20etc.%20of%20this%20community%20in%20just%203%20months%20has%20FAR%20exceeded%20the%20Office%20365%20Network%20on%20Yammer.%20And%20we%20are%20growing%20and%20growing%20every%20day%20and%20planning%20tons%20of%20new%20improvements%20and%20have%20new%20product%20teams%20joining%20each%20week.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EIn%20terms%20of%20traffic%2C%20so%20far%20search%20engines%20have%20referred%20more%20than%2025%2C000%20entrances%20to%20this%20community%20resulting%20in%202%20million%20minutes%20spent%20on%20our%20site.%20Articles%20by%20our%20engineering%20and%20product%20marketing%20teams%20are%20individually%20receiving%20thousands%20(sometimes%20upwards%20of%2030k)%20views.%20Our%20Ignite%20content%20(our%20community%20was%20backend%20social%20experience%20for%20Tech%20Summit%20and%20Ignite)%20are%20receiving%20thousands%20of%20views.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3ENone%20of%20this%20happens%20if%20the%20community%20stays%20on%20Yammer.%20%3CBR%20%2F%3E%3CBR%20%2F%3EYou've%20been%20very%20vocal%20about%20your%20thoughts%20on%20this%20community%2C%20and%20we%20know%20we%20have%20work%20to%20do%20to%20improve%20the%20experience%2C%20but%20we%20are%20moving%20in%20the%20right%20direction.%20The%20incredible%20growth%20of%20this%20community%20(both%20internally%20and%20externally)%20are%20proof%20of%20that.%20We'll%20try%20to%20stay%20as%20transparent%20as%20possible%20and%20I%20hope%20we%20can%20win%20you%20over%20soon.%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-29409%22%20slang%3D%22en-US%22%3ERe%3A%20Metrics%20after%20move%20from%20Yammer%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-29409%22%20slang%3D%22en-US%22%3E%3CP%3EI%20will%20check%20to%20see%20if%20we%20have%20plans%20to%20publicly%20share%20that%20information.%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-29396%22%20slang%3D%22en-US%22%3ERe%3A%20Metrics%20after%20move%20from%20Yammer%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-29396%22%20slang%3D%22en-US%22%3E%3CP%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F179%22%20target%3D%22_blank%22%3E%40Lana%20O'Brien%3C%2FA%3E%2C%20thanks%20but%20those%20numbers%20don't%20really%20provide%20any%20insight%20into%20how%20many%20people%20are%20coming%20to%20this%20network%20as%20a%20result%20of%20doing%20a%20search%20(which%20was%20the%20stated%20reason%20for%20moving%20from%20a%20very%20sucessful%20and%20easy%20to%20use%20yammer%20network)%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThose%20numbers%20do%20indicate%20that%20more%20than%2050%25%20of%20the%20yammer%20network%20members%20have%20not%20moved%20into%20this%20new%20community.%20That%20tells%20me%20that%20we%20lost%20a%20lot%20of%20opportunities%20to%20converse%20with%20people%20that%20had%20been%20motivated%20enough%20to%20register%20through%20Yammer.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-29390%22%20slang%3D%22en-US%22%3ERe%3A%20Metrics%20after%20move%20from%20Yammer%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-29390%22%20slang%3D%22en-US%22%3E%3CP%3EHello%2C%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EI%20wouldn't%20say%20that%20badges%20are%20a%20good%20metric%20to%20compare%2C%20since%20that%20was%20not%20something%20we%20tracked%20in%20Yammer.%20It%20seems%20like%20you%20already%20have%20your%20mind%20up%2C%20but%20here%20are%20public%20metrics%20that%20you%20can%20look%20at%3A%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThis%20Community%203%20months%20in%3A%26nbsp%3B%3C%2FP%3E%0A%3CUL%20id%3D%22community-menu-wrapper-vitality-stat-list%22%20class%3D%22community-menu-vitality-stat-list%22%3E%0A%3CLI%20id%3D%22community-menu-wrapper-vitality-stat-item-1%22%20class%3D%22community-menu-vitality-stat-item%22%3E%3CSPAN%20class%3D%22community-menu-vitality-stat-count%22%3E29.5K%3C%2FSPAN%3E%20%3CSPAN%20class%3D%22community-menu-vitality-stat-title%22%3EMembers%3C%2FSPAN%3E%3C%2FLI%3E%0A%3CLI%20id%3D%22community-menu-wrapper-vitality-stat-item-2%22%20class%3D%22community-menu-vitality-stat-item%22%3E5%2C188%20%3CSPAN%20class%3D%22community-menu-vitality-stat-title%22%3EConversations%20%26lt%3B-%20this%20is%20just%20the%20start%20of%20the%20topic%2C%20not%20the%20total%20number%20of%20replies.%26nbsp%3B%3C%2FSPAN%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22community-menu-vitality-stat-title%22%3EOffice%20365%20Network%20over%2030%20months%20(SPC%20March%202014%20to%20Aug%202016)%3A%3C%2FSPAN%3E%3C%2FP%3E%0A%3CUL%20class%3D%22aa-stat-left-sub%22%3E%0A%3CLI%3E%3CSPAN%20class%3D%22community-menu-vitality-stat-title%22%3E80k%20Members%3C%2FSPAN%3E%3C%2FLI%3E%0A%3CLI%3E560k%20Conversations%26nbsp%3B%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3ESo%2C%20if%20every%20conversations%20has%20on%20average%203%26nbsp%3Breplies%20(just%20a%20conservative%20guess)%2C%20I%20think%20month%20to%20month%20we're%20excedeing%20expections.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-29377%22%20slang%3D%22en-US%22%3ERe%3A%20Metrics%20after%20move%20from%20Yammer%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-29377%22%20slang%3D%22en-US%22%3E%3CP%3ESome%20interesting%20metrics%20can%20be%20seen%20when%20you%20look%20at%20the%20badges%20you%20'earned'.%3C%2FP%3E%3CP%3EVery%20low%20numbers%20across%20quite%20a%20few%20ot%20the%20most%20basic%20acheivements.%3C%2FP%3E%3C%2FLINGO-BODY%3E
Highlighted
Respected Contributor

@Anna Chu It has been a few months since the ill-conceived move from Yammer. How many people are using this new community as a result of search they performed on the public internet?

 

What other metrics have been gathered to document the success (or lack thereof) of the move?

7 Replies
Highlighted

Some interesting metrics can be seen when you look at the badges you 'earned'.

Very low numbers across quite a few ot the most basic acheivements.

Highlighted

Hello, 

 

I wouldn't say that badges are a good metric to compare, since that was not something we tracked in Yammer. It seems like you already have your mind up, but here are public metrics that you can look at: 

 

This Community 3 months in: 

  • 29.5K Members
  • 5,188 Conversations <- this is just the start of the topic, not the total number of replies. 

 

Office 365 Network over 30 months (SPC March 2014 to Aug 2016):

  • 80k Members
  • 560k Conversations 

 

So, if every conversations has on average 3 replies (just a conservative guess), I think month to month we're excedeing expections.

Highlighted

@Lana O'Brien, thanks but those numbers don't really provide any insight into how many people are coming to this network as a result of doing a search (which was the stated reason for moving from a very sucessful and easy to use yammer network)

 

Those numbers do indicate that more than 50% of the yammer network members have not moved into this new community. That tells me that we lost a lot of opportunities to converse with people that had been motivated enough to register through Yammer.

Highlighted

I will check to see if we have plans to publicly share that information. 

Highlighted

Hey Dean, 

 

I am happy to share a few numbers, but first I'd like to note that you are missing a VERY large piece of the puzzle when thinking about why we moved and measuring the success of our move. The ability to lurk and get content out from behind the Yammer sign on wall is clearly larger than just being indexable. Also, Yammer doesn't offer the customizations that we need as a marketing community and platform. It also didn't allow for a community structure, since there are no sub-groups or hierarchy. The list goes on and on, but that 90k number is not reflective of the actual engaged users on the community. Traffic, usage, consumption, etc. of this community in just 3 months has FAR exceeded the Office 365 Network on Yammer. And we are growing and growing every day and planning tons of new improvements and have new product teams joining each week.

 

In terms of traffic, so far search engines have referred more than 25,000 entrances to this community resulting in 2 million minutes spent on our site. Articles by our engineering and product marketing teams are individually receiving thousands (sometimes upwards of 30k) views. Our Ignite content (our community was backend social experience for Tech Summit and Ignite) are receiving thousands of views.

 

None of this happens if the community stays on Yammer.

You've been very vocal about your thoughts on this community, and we know we have work to do to improve the experience, but we are moving in the right direction. The incredible growth of this community (both internally and externally) are proof of that. We'll try to stay as transparent as possible and I hope we can win you over soon. 

 

 

 

 

 

 

Highlighted

I will be a lot more satisfied with this community when the UI stops becoming a huge annoyance.

 

The Yamjams used to be exciting and fun, the AMAs yesterday were incredibly difficult to follow and participate in.

 

The fact that I can't see Unread content is BEYOND frustrating

Highlighted

Just found that badges metric. Yes, that's not a good to compare, but good enough to see the stats. From about 30K members

- only ~1.7K started at least one conversation and ~3.2K make at least one reply. Other more than 25K posted nothing.

- if to calculate bit more active people 170 (not K, just 170) started at least 5 conversations and ~550 posted 5 and more replies.

 

That's if badges stats is correct, this site doesn't like arithmetic - i often see negative number of conversations on community tile, etc.

 

And if take Lana's figures

- 0.18 conversations/member and 1,729 conversations/month for this community

- 7.0 conversations/member and 18,667 conversations/month for O365 network

 

Let compare in 27 months...