<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	>

<channel>
	<title>David's Blog</title>
	<atom:link href="http://blogs.cetis.ac.uk/david/feed/" rel="self" type="application/rss+xml" />
	<link>http://blogs.cetis.ac.uk/david</link>
	<description>David Sherlock at CETIS</description>
	<pubDate>Tue, 22 Jan 2013 15:30:50 +0000</pubDate>
	
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
			<item>
		<title>Analytics Tools and Infrastructure Briefing Paper</title>
		<link>http://blogs.cetis.ac.uk/david/2013/01/22/analytics-tools-and-infrastructure/</link>
		<comments>http://blogs.cetis.ac.uk/david/2013/01/22/analytics-tools-and-infrastructure/#comments</comments>
		<pubDate>Tue, 22 Jan 2013 15:20:41 +0000</pubDate>
		<dc:creator>dms2ect</dc:creator>
		
		<category><![CDATA[analytics]]></category>

		<guid isPermaLink="false">http://blogs.cetis.ac.uk/david/?p=373</guid>
		<description><![CDATA[I volenteered to help write a briefing paper on analytic tools in the hope of stealing some time to play with cool stuff. The joy of having some play time in work quickly evaporated when it struck me that not only is there a very large number of tools but also that they come from [...]]]></description>
			<content:encoded><![CDATA[<p>I volenteered to help write a briefing paper on analytic tools in the hope of stealing some time to play with cool stuff. The joy of having some play time in work quickly evaporated when it struck me that not only is there a very large number of tools but also that they come from communities of such diverse practices.   It was quickly evident that creating a full list of tools would be impossible and almost certainly out of date the moment it was released.</p>
<p>As such, Wilbert and I have opted to provide a map of communities with information on landmark tools hoping to guide the you to a community, tool, or set of tools that fits your needs.</p>
<p>The briefing paper “<a href="http://publications.cetis.ac.uk/2013/535">Analytics Tools and Infrastructure</a>” has just been released and is tenth in the <a href="http://publications.cetis.ac.uk/c/analytics">CETIS Analytics Series.</a></p>
]]></content:encoded>
			<wfw:commentRss>http://blogs.cetis.ac.uk/david/2013/01/22/analytics-tools-and-infrastructure/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Our favourite posts of 2012</title>
		<link>http://blogs.cetis.ac.uk/david/2013/01/09/our-favourite-posts-of-2012/</link>
		<comments>http://blogs.cetis.ac.uk/david/2013/01/09/our-favourite-posts-of-2012/#comments</comments>
		<pubDate>Wed, 09 Jan 2013 13:27:17 +0000</pubDate>
		<dc:creator>dms2ect</dc:creator>
		
		<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://blogs.cetis.ac.uk/david/?p=362</guid>
		<description><![CDATA[Those who subscribe to the CETIS newsletter will receive the top posts of the month ranked by the total number of views they've had, while its nice to see what our audience find interesting sometimes we have our own personal favourites that we'd like to share. I asked CETIS staff if they wanted to share [...]]]></description>
			<content:encoded><![CDATA[<p>Those who subscribe to the CETIS newsletter will receive the top posts of the month ranked by the total number of views they've had, while its nice to see what our audience find interesting sometimes we have our own personal favourites that we'd like to share. I asked CETIS staff if they wanted to share any of blog posts they had written in 2012 they were fond of and why..</p>
<p><strong>Sharon</strong>:<br />
My favourite post of 2012 is "<a href="http://blogs.cetis.ac.uk/accessibility/2012/12/04/the-mooc-just-got-even-better/">The MOOC just got even better</a>", which mentions some of my reflections on taking Stanford's HCI MOOC over the autumn semester. There has been a lot of MOOC-bashing lately and whilst they're not perfect (in fact Coursera has only been around for a year), from a student's point of view they're a great way to access free education from reputable institutions. Sometimes I think we're so busy looking at the technology or the process, that we forget about the student. To be involved in something at the beginning that will undoubtedly mature and change is exciting and I look forward to seeing how MOOCs will evolve.</p>
<p><strong>Simon</strong>:<br />
For this year, I choose not a post that has received comments, but one that has not, <a href="http://blogs.cetis.ac.uk/asimong/2012/08/11/follower-guidance-idea/">Follower guidance idea</a>.</p>
<p>I had first used the term "follower guidance" in a CETIS e-mail in May 2011, so it had brewed in my mind for over a year before this exposition. I think we (in CETIS/IEC) should be doing this kind of exposition of vision, whether or not it is immediately recognised or responded to. In this case, I have to accept that people have not yet digested the idea enough to comment on it, though when I explain it face-to-face it seems to be understood and appreciated at some level. So I offer this post as a hope for the future -- maybe it will be referred to by others as the ideas come to make more sense.</p>
<p><strong>Sheila:</strong><br />
First one is "<a href="http://blogs.cetis.ac.uk/sheilamacneill/2012/01/26/a-converstaion-around-what-it-means-to-be-a-digital-university/">a conversation around what it means to be a digital university</a>".  This was a personal favourite as it was more of a staff development activity for me as it allowed me to co-author some thoughts with my Strathclyde Uni colleague Bill Johnston around strategic aspects of becoming a digital university. We've had very positive feedback, conference presentation and a couple of papers in the pipeline from this. We've also been approached by Napier University to be critical friends over the next year as they develop their digital strategy.</p>
<p>The second one, is one of those posts that I kind of wrote off the cuff and is "<a href="http://blogs.cetis.ac.uk/sheilamacneill/2012/03/09/learning-analytics-where-do-you-stand/">learning analytics, where do you stand?</a>". It was really useful to reflect on a presentation from Gardner Campbell about learning analytics, and I got quite a few comments, which is always good. The post  also helped to set the scene for our work on analytics this year which culminating in the CETIS Analytics Series.</p>
<p><strong>Martin</strong><br />
<a href="http://mashe.hawksey.info/2012/08/notes-on-technology-behind-cmoocs-show-me-your-aggregation-architecture-and-ill-show-you-mine/"> Notes on technology behind cMOOCs: Show me your aggregation architecture and I’ll show you mine</a><br />
This post started as a simple analysis of the infrastructure around MOOCs, but as a wrestled with the text  a couple of revelations emerged.<br />
Focusing on the connectivist style of courses it’s evident that instructors are picking up the tools around them to manage courses.  Because, as Downes commented, ‘users are assumed to be outside the system for the most part, inhabiting their own spaces’ aggregation of data becomes key. Even when you deal with well-established technologies like blogs there are interoperability issues with extracting data like category/tags and user comments. One of the key challenges in moving connectivist style MOOCs forward is developing tools that can effectively aggregate data from a range of sources and provide actionable insights for both tutors and students. This post highlights some current work and possible future directions.</p>
<p><a href="http://mashe.hawksey.info/2012/03/do-you-git-it-open-educational-resourcespractices-meets-software-version-control/">Do you git it?: Open educational resources/practices meets software version control</a><br />
Software version control tools like Git have long provided software developers a space to collaboratively work on projects providing an easy way track, contribute and modify code even when offline. Given the features of remixing and branch existing material you’d think it would make the ideal repository for open educational resources (OER). This solution is not without its issues such as confusing terminology and very  structured workflows but it’s interesting to see non-coders adopt Git as a place to host their content. This post highlights some existing examples like open bid writing, music and course content and asks should we be Gitting OER.</p>
<p><strong>Phil</strong><br />
<a href="http://blogs.cetis.ac.uk/philb/2012/10/26/at-the-end-of-the-jlern-experiment/ ">At the end of the JLeRN experiment</a></p>
<p>Not so much because of what is in the blog post but because of the work it represents which illustrates how CETIS can spot an innovation that looks interesting and work with Jisc and Jisc services to trial it in a UK F&amp;HE context.</p>
<p><strong>Lorna</strong>:</p>
<p class="p1">Since Phil has already chosen his JLeRN Experiment blog post, I'm going to choose this:<a href="http://blogs.cetis.ac.uk/lmc/2012/08/31/oer-booksprint-reflections/"> OER Booksprints Reflections</a></p>
<p class="p1">I've chosen this as post as undertaking a booksprint to synthesise, record and disseminate the technical outputs and issues surfaced by Jisc programmes was an entirely new approach for both Jisc and CETIS.   A booksprint is essentially an accelerated facilitated writing retreat and our aim was to draw together the significant technical outputs of three years of the <a href="http://www.jisc.ac.uk/oer">JISC / HEA Open Educational Resources Programme</a>s, reflect on issues that arose and identify future directions.  I think its fair to say that we all approached the task with some trepidation and perhaps even a little scepticism but we were all greatly surprised and encouraged by the result: "Technology for open educational resources - Into the  Wild",  which will be available to download as a free ebook, or to print on demand in the new year.  On reflection, we all agreed that this was a very effective way to synthesise the complex outputs of the programmes and I would certainly recommend this approach to others.  And who knows, we might even plan another sprint in the new year!</p>
]]></content:encoded>
			<wfw:commentRss>http://blogs.cetis.ac.uk/david/2013/01/09/our-favourite-posts-of-2012/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Thoughts on a huge social media strategy</title>
		<link>http://blogs.cetis.ac.uk/david/2012/11/08/thoughts-on-a-huge-social-media-strategy/</link>
		<comments>http://blogs.cetis.ac.uk/david/2012/11/08/thoughts-on-a-huge-social-media-strategy/#comments</comments>
		<pubDate>Thu, 08 Nov 2012 12:07:01 +0000</pubDate>
		<dc:creator>dms2ect</dc:creator>
		
		<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://blogs.cetis.ac.uk/david/?p=359</guid>
		<description><![CDATA[Whether you’re trying to flog wares, advertise consultancy skills or simply have a big ego; it seems that we all want to abuse social media for a cause. I find it interesting that we all choose to use different social media services and guess that our strategy depends on on many factors such as what [...]]]></description>
			<content:encoded><![CDATA[<p>Whether you’re trying to flog wares, advertise consultancy skills or simply have a big ego; it seems that we all want to abuse social media for a cause. I find it interesting that we all choose to use different social media services and guess that our strategy depends on on many factors such as what it is we are sharing, the audiences we are trying to reach and ultimately the user base size of the social media service.</p>
<p>Yesterday Obama claimed the most popular Twitter and Facebook posts of all time with over 640 000 retweets and 3 million likes of a picture of him and his wife and it occurred to me that the two huge social media strategies; that of the U.S presidential candidates will be winding down.</p>
<p>With my social media strategy restricted to posting on Google Site’s and this very blog I thought it would be interesting to poke about and reflect on how the candidates things.  I found much analysis of both Obama’s and Romney’s campaign already exists; here are some things I found interesting:</p>
<p><strong>Email still plays a huge role</strong></p>
<p><a href="http://www.klaviyo.com/blog/2012/11/06/re-hey-an-analysis-obamaromney-emails/ ">Ed Hallen</a> did an analysis of both candidates email campaigns. The strategies of both candidates are quite complex, but it is clear that email plays a huge roll and there seem to be some important themes to the strategy.</p>
<p>•<span> </span>It matters who in the organisation sends the message.</p>
<p>Both campaigns restricted the times that messages appeared to come from the candidates themselves to more urgent emails. Other emails came from the VP-candidate or spouse.</p>
<p>•<span> </span>Subject matters</p>
<p>Emails from the Democrat camp were often punchy with a semi colon, which Ed claims was a tested way making people more likely to read the message. On the other hand the Republican camp used relaxed one word subjects. ‘Hey’ being the most common</p>
<p>*  Know your audience</p>
<p>Having signed up to the lists, both camps know that they are preaching to the converted.  It seems the list were more likely to be used for issues such as fund raising then trying to get new votes.</p>
<p><strong>Obama on Reddit</strong></p>
<p>Both sides had the obvious online presence: Twitter, Facebook, Youtube, Google + and Linked in but I was shocked to see <a href="http://www.reddit.com/r/IAmA/comments/z1c9z/i_am_barack_obama_president_of_the_united_states/"> Obama do an ‘Ask me Anything’</a> on my favourite news aggregation site 2 months ago; but in retrospect Reddit is the perfect choice.</p>
<p>•<span> </span>Targeting an audience on the edge</p>
<p>Reddit often comes <a href="http://www.amerika.org/technology/the-entropy-of-reddit">under attack</a> for suffering from group think popular opinions voted to the top with disagreements being voted down and often deleted. The demographic of Reddit in the U.S. is young males who lean towards the Democrats. This meant Obama could essentially reaching out to an audience who already supported him but were in a demographic not likely. The groupthink mentality would mean that  arguments against his replies would not float to the top ( Plus his reference to internet memes gave him geek cred –<a href="http://knowyourmeme.com/memes/obama-rage-face-not-bad"> Not Bad! </a>).</p>
<p><strong>Social sites create their own analysis dashboards</strong></p>
<p>While twitter was an obvious choice for both candidates I found it interesting that twitter worked with Topsy to <a href="https://election.twitter.com/">create a dashboard </a>to mine itself for data on the candidates and the topics surrounding them.  I felt this was a sign that the service knows just how important the data it holds is and was a clear message to the world that if you want to win your cause you have to try and play its game. Twitter wasn’t the only service doing this, Microsoft's <a href="http://www.bing.com/elections"> example can be found here</a>.</p>
<p><strong>Mitt Romney on 4chan</strong></p>
<p>(I kid)</p>
<div></div>
]]></content:encoded>
			<wfw:commentRss>http://blogs.cetis.ac.uk/david/2012/11/08/thoughts-on-a-huge-social-media-strategy/feed/</wfw:commentRss>
		</item>
		<item>
		<title>iTunesU for Games?</title>
		<link>http://blogs.cetis.ac.uk/david/2012/07/20/some-thoughts-on-the-fight-to-get-a-game-digital-distribution-system-in-to-education/</link>
		<comments>http://blogs.cetis.ac.uk/david/2012/07/20/some-thoughts-on-the-fight-to-get-a-game-digital-distribution-system-in-to-education/#comments</comments>
		<pubDate>Fri, 20 Jul 2012 16:17:42 +0000</pubDate>
		<dc:creator>dms2ect</dc:creator>
		
		<category><![CDATA[Games]]></category>

		<guid isPermaLink="false">http://blogs.cetis.ac.uk/david/?p=350</guid>
		<description><![CDATA[As those who followed the Game Group administration story  earlier this year know, purchasing physical media for games is on the way out. This isn't a recent thing, for many years PC gamers have had to install digital distribution systems to get their hands on the the latest games.
The most popular PC gaming distribution system is [...]]]></description>
			<content:encoded><![CDATA[<p>As those who followed the <a href="http://www.bbc.co.uk/news/business-17512143">Game Group administration story </a> earlier this year know, purchasing physical media for games is on the way out. This isn't a recent thing, for many years PC gamers have had to install digital distribution systems to get their hands on the the latest games.</p>
<p>The most popular PC gaming distribution system is <a href="http://store.steampowered.com/">Steam</a>. Steam is developed by the <a href="http://en.wikipedia.org/wiki/Valve_Corporation">Valve Corporation</a> who also develop a range of very successful games based on their in-house game engine, <a href="http://en.wikipedia.org/wiki/Source_(game_engine)">Source</a>. Although Valve do not release sales figures, two years ago it was estimated by a rival company that Steam owned 70% of the digital distribution games market, we know that since then the service has grown in terms of audience, with just <a href="http://store.steampowered.com/stats/">under 5 million people logging in to the service </a>most days.</p>
<p>While Valve have supported game modding communities for a long time, they have recently turned their attention to schools with a very impressive set of free tools for education. The catch? You have to install their digital distribution and sign up to the “Steam for Schools Initiative”.</p>
<p>The tools:</p>
<ul>
<li>Valve Learning with Portals</li>
</ul>
<p>Valve offers free copies of Portal 2 and Portal 2 Puzzle for use in physics, maths, chemistry, language, design classes and offer lesson plans to available at <a href="http://www.learnwithportals.com/">http://www.learnwithportals.com/</a></p>
<ul>
<li>Valve Filmmaker</li>
</ul>
<p>There are lots of high profile film makers at Valve and the company are well known for their high quality 'shorts'. Valve now offer their in house film making software to anybody that wants to give it a whirl for free. Videos are made inside of the game engine. You can take a peak of whats on offer here:</p>
<a href="http://blogs.cetis.ac.uk/david/2012/07/20/some-thoughts-on-the-fight-to-get-a-game-digital-distribution-system-in-to-education/"><p><em>Click here to view the embedded video.</em></p></a>
<ul>
<li>Hammer</li>
</ul>
<p>The <a href="http://en.wikipedia.org/wiki/Valve_Hammer_Editor">Valve Hammer Editor</a> is a free map editing suite tused to teach game design.</p>
<ul>
<li>Steam workshop</li>
</ul>
<p>Steam offers a hub for users to share and publish (and make profit on!) their creations in the tools.  Proud of the Portal 2 level you made in a physics class? Share it!</p>
<p>Steam for Schools is an aggressive move by Valve, the tools that they are offering are very high quality from a high profile publisher. It surly tells us that Valve thinks that games and storytelling have a big part to play in education.</p>
<p>Some other stories of interest:</p>
<ul>
<li><a href="http://news.bbc.co.uk/1/hi/technology/7867861.stm">Source engine used for fire drill</a></li>
<li><a href="http://gamrconnect.vgchartz.com/thread.php?id=144807">Valve 'Games could fix education'</a></li>
</ul>
]]></content:encoded>
			<wfw:commentRss>http://blogs.cetis.ac.uk/david/2012/07/20/some-thoughts-on-the-fight-to-get-a-game-digital-distribution-system-in-to-education/feed/</wfw:commentRss>
		</item>
		<item>
		<title>My First Ebook</title>
		<link>http://blogs.cetis.ac.uk/david/2012/06/26/my-first-ebook/</link>
		<comments>http://blogs.cetis.ac.uk/david/2012/06/26/my-first-ebook/#comments</comments>
		<pubDate>Tue, 26 Jun 2012 11:32:20 +0000</pubDate>
		<dc:creator>dms2ect</dc:creator>
		
		<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://blogs.cetis.ac.uk/david/?p=335</guid>
		<description><![CDATA[When I purchase an item I like having a physical thing to hold and show for my purchase. There is something about my physical CD collection that my digital one does not capture; is it all those colourful cases, the fancy sleeve artwork, the smell of a new cd or am I just a hoarder? [...]]]></description>
			<content:encoded><![CDATA[<p>When I purchase an item I like having a physical thing to hold and show for my purchase. There is something about my physical CD collection that my digital one does not capture; is it all those colourful cases, the fancy sleeve artwork, the smell of a new cd or am I just a hoarder? My addiction to the physical means I am often late to the party where purchasing digital versions of media content is concerned. When I do finally cave in and opt for my first digital taste of something I remember what it was and the exact reason I opted for digital over physical. My first digital CD was a <a href="http://en.wikipedia.org/wiki/Bug_Sessions">limited print and only sold in physical form at U.S gigs</a> . My first digital games came from a <a href="http://www.humblebundle.com/">‘pay what you want’ indie charity bundle.</a></p>
<p>Yesterday I purchased a physical book, the book is called <a href="http://shop.oreilly.com/product/0636920022565.do">Getting started with Dwarf Fortress</a>. For those that don’t know<a href="http://www.bay12games.com/dwarves/"> Dwarf Fortress</a> is the 2nd greatest game ever (fact) and is free to download and play. It’s a very complex city building game where you manage a bunch of fortress building dwarfs while coping with many dangers such as goblins, vampires dwarfs, lack of beer and ‘the occasional rampant megabeast’. It’s a hard game with a high learning curve and ASCII graphics. My favourite thing about it is the sheer amount of things in the game. The below flowchart is a community creation to show a beginner what should be done in order to get started:</p>
<p><a href="http://dwarffortresswiki.org/index.php/From_Caravan_to_Happy_Dwarves"><img class="aligncenter size-full wp-image-340" title="flow" src="http://blogs.cetis.ac.uk/david/files/2012/06/flow.png" alt="flow" width="743" height="882" /></a></p>
<p>The game is constantly updated and as a result this flowchart gets bigger and bigger!</p>
<p>The problem with a physical book on a subject like Dwarf Fortress is that it can date quickly. While the book will be a great help for me in turning Atolkol into a successful Dwarf fortress I wonder how useful it will be two or three game updates down the line. Will the book have a short shelf life with the subject of the book being constantly updated? Reading the back of the book I spotted this about free updates:</p>
<p><a href="http://blogs.cetis.ac.uk/david/files/2012/06/imag0713.png"><img class="aligncenter size-full wp-image-337" title="imag0713" src="http://blogs.cetis.ac.uk/david/files/2012/06/imag0713.png" alt="imag0713" width="400" height="301" /></a></p>
<p>I headed over to forums and the author had this to say on the matter:</p>
<p>“Yes - it isn't well explained on O'Reilly's site, but O'R ebook customers will be alerted when the book is updated and able to grab a new copy. Other owners can, if they wish, "register" their book with O'R for $5 and also get the updates.</p>
<p>Print book will always be current to the version bought at the time of purchase. The current version is, basically the May releases of DF - so, exceptionally current“</p>
<p>This is a new concept to me; it could be common practice that I haven’t noticed, as I haven’t purchased an Ebook before. My shelf is full of text books on the same subject, not because I particularly love Java but because updates to it render old books useless. I like the idea of 'patching books' that a book can evolve along with its subject matter.</p>
<p>I checked out the Ebook and not only does it get updates, it is full of beautiful colourful pictures that don’t work very well in the black and white book. So now I have another digital media content first, my first Ebook.</p>
]]></content:encoded>
			<wfw:commentRss>http://blogs.cetis.ac.uk/david/2012/06/26/my-first-ebook/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Sharing ideas in a distributed organisation</title>
		<link>http://blogs.cetis.ac.uk/david/2012/06/08/sharing-ideas-in-a-distributed-organisation/</link>
		<comments>http://blogs.cetis.ac.uk/david/2012/06/08/sharing-ideas-in-a-distributed-organisation/#comments</comments>
		<pubDate>Fri, 08 Jun 2012 09:11:26 +0000</pubDate>
		<dc:creator>dms2ect</dc:creator>
		
		<category><![CDATA[data visualisation]]></category>

		<guid isPermaLink="false">http://blogs.cetis.ac.uk/david/?p=325</guid>
		<description><![CDATA[A good thing about working in JISC CETIS is being surrounded by the wide array of interests and ideas of its staff. A bad thing about working for JISC CETIS is with its distributed nature (and the fact everybody is always so busy!) it is always not possible to sit down and have a good [...]]]></description>
			<content:encoded><![CDATA[<p>A good thing about working in JISC CETIS is being surrounded by the wide array of interests and ideas of its staff. A bad thing about working for JISC CETIS is with its distributed nature (and the fact everybody is always so busy!) it is always not possible to sit down and have a good natter about these interests.</p>
<p>Sheila<a href="http://blogs.cetis.ac.uk/sheilamacneill/2012/06/07/some-thoughts-on-web-analytics-uisng-our-work-on-analytics/" target="_blank"> recently blogged </a>about social analytics and the way people share things. I enjoyed the post as I find resource sharing online a really interesting area.  I increasingly find myself getting anxious about how I share things online and to which online persona ideas and resources are attached. I find myself carving out an online identity created of different levels of obscurity where I push my outputs up the levels as and when I feel more comfortable with them. I find it interesting that <a href="http://www.youtube.com/watch?feature=player_embedded&amp;v=e3Zs74IH0mc">Christopher Poole’s</a> latest social network allows you to work anonymously and then gives you the option to claim the work at a later date.</p>
<p>I left a comment on Sheila’s post and she replied back to me. First through a comment back on the post followed up by a quick skype chat. It occurred to me then that an online social structure that has worked very well for me has been the JISC CETIS blogs.  An environment of regular blogging and commenting allows ideas to be shared and grow through the distributed organisation.</p>
<p>Over the past week or so I’ve been collecting data for a report and struggling with a way to analyse it. I came up with a method of turning networks I can spot in my CSV files into something network analysis tools can understand (<a href="http://www.davidsherlock.info/network-analysis">which you can read about further down the chain of obscurity</a>). Now that I'm obsessed with running data through the technique I thought I’d run CETIS blog authors and the conversations that join them over the method and steal <a href="http://blog.ouseful.info/2011/07/07/visualising-twitter-friend-connections-using-gephi-an-example-using-wireduk-friends-network/">Tony’s visualisation technique</a>. I’ve removed pingbacks and such.  It might not be useful but it tickles the occipital lobe.</p>
<p><a href="http://blogs.cetis.ac.uk/david/files/2012/06/corinationstreet.png"><img class="aligncenter size-full wp-image-326" title="commentlinks" src="http://blogs.cetis.ac.uk/david/files/2012/06/corinationstreet.png" alt="commentlinks" width="800" height="918" /></a></p>
]]></content:encoded>
			<wfw:commentRss>http://blogs.cetis.ac.uk/david/2012/06/08/sharing-ideas-in-a-distributed-organisation/feed/</wfw:commentRss>
		</item>
		<item>
		<title>What are we writing about? Using CETIS Publications RSS in R</title>
		<link>http://blogs.cetis.ac.uk/david/2012/03/20/what-are-we-writing-about-using-cetis-publications-rss-in-r/</link>
		<comments>http://blogs.cetis.ac.uk/david/2012/03/20/what-are-we-writing-about-using-cetis-publications-rss-in-r/#comments</comments>
		<pubDate>Tue, 20 Mar 2012 11:56:03 +0000</pubDate>
		<dc:creator>dms2ect</dc:creator>
		
		<category><![CDATA[data visualisation]]></category>

		<guid isPermaLink="false">http://blogs.cetis.ac.uk/david/?p=292</guid>
		<description><![CDATA[I have been poking around Adam Coopers text mining weak signals in R code, and being too lazy to collect data in CSV format wondered if I could come up with something similar that used RSS feeds. I discovered it was really easy to read and start to mine RSS feeds in R, but there [...]]]></description>
			<content:encoded><![CDATA[<p>I have been poking around Adam Coopers <a href="https://github.com/arc12/Text-Mining-Weak-Signals" target="_blank">text mining weak signals in R code</a>, and being too lazy to collect data in CSV format wondered if I could come up with something similar that used RSS feeds. I discovered it was really easy to read and start to mine RSS feeds in R, but there didn't seem to be much help available on the web so I thought I'd share my findings.</p>
<p>My test case was the new CETIS publications site, <a href="http://blogs.cetis.ac.uk/philb/2012/03/13/cetis-publications-now-on-wordpress/">Phil has blogged </a>about how the underlying technology behind site is wordpress, which means it has an <a href="http://publications.cetis.ac.uk/feed">easy to find feed</a>. I wrote a very small script to test things out that looks something like this:</p>
<pre>
<code>
      library("XML")
      library("tm")
      doc&lt;-xmlTreeParse("http://publications.cetis.ac.uk/feed")
      src&lt;-xpathApply(xmlRoot(doc), "//category")
      tags&lt;- NULL

      for (i in 1:length(src)) {
             tags&lt;- rbind(tags,data.frame(tag=tag&lt;-xmlSApply(src[[i]], xmlValue)) )
      }
</code>
</pre>
<p>This simply grabs the feed and puts all the categories tags into a dataframe. I then removed the tags that referred to the type of publication and plotted it as a piechart. I'm pretty sure this isn't the prettiest way to do this, but it was very quick and worked!</p>
<pre>
<code>
         cats &lt;- subset(tags, tag != "Briefing Paper" &amp; tag != "White Paper" &amp; tag != "Other Publication" &amp; tag != "Journal Paper"  &amp; tag != "Report")
         levels(cats$tag)
         df$tag = factor(df$tag)
         pie(table(cats$tag))
</code>
</pre>
<p>Which gave me a visual breakdown of all the categories used on our publications site and how  much they are used:</p>
<p><a href="http://blogs.cetis.ac.uk/david/files/2012/03/types.png"><img class="aligncenter size-full wp-image-293" title="types" src="http://blogs.cetis.ac.uk/david/files/2012/03/types.png" alt="types" width="625" height="310" /></a>I was surprised at how much of a 5 minute job it was. It struck me that because the feed has the publication date it would be easy to do the Google Hans Rosling style chart with it. My next step would be to grab multiple feeds and use some of Adams techniques on the descriptions/content of the feed.</p>
<h2>*UPDATE*</h2>
<p>I had been interested in how to grab RSS and pump it into R and 'interesting things we can do with the CETIS publications RSS feed' had been a bit of an after thought. Martin brought up the idea of using the feed to drive a wordl (see comments). I stole the code from the comment and changed my code slightly so that I was grabbing the publication descriptions rather than the tags used... This is what it came up with.. Click to enlarge</p>
<p><a href="http://blogs.cetis.ac.uk/david/files/2012/03/wordl.png"><img class="aligncenter size-medium wp-image-307" title="wordl" src="http://blogs.cetis.ac.uk/david/files/2012/03/wordl-300x283.png" alt="wordl" width="300" height="283" /></a></p>
]]></content:encoded>
			<wfw:commentRss>http://blogs.cetis.ac.uk/david/2012/03/20/what-are-we-writing-about-using-cetis-publications-rss-in-r/feed/</wfw:commentRss>
		</item>
		<item>
		<title>SNA session at CETIS 12</title>
		<link>http://blogs.cetis.ac.uk/david/2012/02/24/sna-session-at-cetis-12/</link>
		<comments>http://blogs.cetis.ac.uk/david/2012/02/24/sna-session-at-cetis-12/#comments</comments>
		<pubDate>Fri, 24 Feb 2012 10:12:43 +0000</pubDate>
		<dc:creator>dms2ect</dc:creator>
		
		<category><![CDATA[data visualisation]]></category>

		<guid isPermaLink="false">http://blogs.cetis.ac.uk/david/?p=286</guid>
		<description><![CDATA[I attended the SNA session at the CETIS conference hosted by Lorna, Sheila, Tony and Martin. Before the session I had blogged about some of the questions I had on SNA  and although I think I have more new questions than answers I feel like things are much clearer now. My mind is still [...]]]></description>
			<content:encoded><![CDATA[<p>I attended the SNA session at the CETIS conference hosted by Lorna, Sheila, Tony and Martin. Before the session <a href="http://blogs.cetis.ac.uk/david/2012/01/18/visualisation-session-at-the-cetis-conference-thoughts-and-resources/">I had blogged about some of the questions I had on SNA </a> and although I think I have more new questions than answers I feel like things are much clearer now. My mind is still going over the conversations that were had at the session but these are the main themes and some early thoughts that I came away with.</p>
<p><strong>What are the quick wins?</strong><br />
At the start of the session Sheila asked the question ‘What are the quick wins?’.   While Tony and Martins presentations were excellent I think it is hard for people who don’t have their head regularly in this space to replicate the techniques quickly. Lorna said that although she understood what was happening in the SNA examples there was some ‘secret magic that she couldn’t replicate when doing it for herself, Tony agreed that when you work in this area for a while you start to develop a workflow and understand some of the quirks of the software. I could relate to Lorna's dilema as it took me a few hours of using Gephi just to know exactly when I needed to force quit the program and start all over again.</p>
<p>So for people who want to find out useful information about social networks but don’t have the time to get into the secret magic of SNA can we develop quick and simple tools that answer quick and simple questions?</p>
<p><strong>The crossover between data driven visualisations and SNA</strong><br />
The session helped me make a clear distinction between <a href="http://en.wikipedia.org/wiki/Data_driven_journalism">Data Driven Journalism</a> and SNA . While there is a crossover between the two the reasons for doing them are quite different. SNA is a way to study social networks and data driven visualisations are a way to convey a story to an audience. Although the two do cross over I found that making distinctions between them both helped me get to grips with the ‘why is it worth doing this’ question.</p>
<p><strong>Data Validation</strong><br />
Martin made the point that when he was playing with <a href="http://prod.cetis.ac.uk">PROD</a> data to create visualisations he found that it was a great way of validating the data itself as he managed to spot errors and feed that back to Wilbert and myself.</p>
<p><strong>Lies, Damned Lies and Pretty Pictures</strong><br />
Amber Thomas did a fantastic presentation, if you missed the <a href="http://www.slideshare.net/JISC/social-network-analytics-in-education-and-research-lies-damned-lies-and-pretty-pictures">session it is available here.</a> I felt Amber had really thought about the ‘How is this useful?’ question and I felt lots of pieces of the puzzle click into place during the presentation. I really recommend spending the time to go through the slides.</p>
<p>Thanks to Sheila, Lorna, Amber, Tony and Martin for an interesting session.</p>
<p> <a href="https://plus.google.com/112964580858645776856? rel=author">Google</a></p>
]]></content:encoded>
			<wfw:commentRss>http://blogs.cetis.ac.uk/david/2012/02/24/sna-session-at-cetis-12/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Standards used in JISC programmes and projects over time</title>
		<link>http://blogs.cetis.ac.uk/david/2012/02/01/using-r-to-visualise-standards-in-prod/</link>
		<comments>http://blogs.cetis.ac.uk/david/2012/02/01/using-r-to-visualise-standards-in-prod/#comments</comments>
		<pubDate>Wed, 01 Feb 2012 21:03:15 +0000</pubDate>
		<dc:creator>dms2ect</dc:creator>
		
		<category><![CDATA[data visualisation]]></category>

		<guid isPermaLink="false">http://blogs.cetis.ac.uk/david/?p=263</guid>
		<description><![CDATA[Today I took part in an introduction to R workshop being held at The University of Manchester. R is a software environment for statistics  and while it does all sorts of interesting things that are beyond my ability one thing that I can grasp and enjoy is exploring all the packages that are available for R, these packages extend [...]]]></description>
			<content:encoded><![CDATA[<p>Today I took part in an introduction to R workshop being held at The University of Manchester. <a href="http://www.google.co.uk/url?sa=t&amp;rct=j&amp;q=r&amp;source=web&amp;cd=1&amp;ved=0CCwQFjAA&amp;url=http%3A%2F%2Fwww.r-project.org%2F&amp;ei=AKIpT9KJMM_NsgaN1vTEAQ&amp;usg=AFQjCNFq9BSTD_8y4svhPlIv_58OxEpd5A&amp;sig2=Hku39B5LDfsqbq84tGVhnA">R</a> is a software environment for statistics  and while it does all sorts of interesting things that are beyond my ability one thing that I can grasp and enjoy is exploring all the packages that are available for R, these packages extend Rs capabilities and let you do all sorts of cool things in a couple of lines of code.</p>
<p style="text-align: left; ">The target I set out for myself was to use <a href="http://prod.cetis.ac.uk">JISC CETIS Project Directory</a> data and find a way of visualising standards used in JISC funded projects and programmes over time. I found a Google Visualisation package and using this I was surprised at how easy it was to generate an output , the hardest bits being manipulating the data (and thinking about how to structure it).  Although my output from the day is incomplete I thought I’d write up my experience while it is fresh in my mind.</p>
<p>First I needed a dataset of projects, start dates, standards and programme. I got the results in CSV format by using the sparqlproxy web service that<a href="https://docs.google.com/document/pub?id=1i4STANwqrEy_XjAewo12OjWq3ZCe0tRosUhNGvhAoo0"> I use in this tutorial</a> and stole and edited a query from <a href="https://docs.google.com/document/d/1atVIAjKoZl1dUzq7jYys0c7ObMVMULmuC_eZXlMhDh8/edit?hl=en_US">Martin</a></p>
<p>Sparql:</p>
<blockquote><p>PREFIX rdfs:<br />
PREFIX jisc:<br />
PREFIX doap:<br />
PREFIX prod:<br />
SELECT DISTINCT ?projectID ?Project ?Programme ?Strand ?Standards ?Comments ?StartDate ?EndDate<br />
WHERE {<br />
?projectID a doap:Project .<br />
?projectID prod:programme ?Programme .<br />
?projectID jisc:start-date ?StartDate .<br />
?projectID jisc:end-date ?EndDate .<br />
OPTIONAL { ?projectID prod:strand ?Strand } .<br />
# FILTER regex(?strand, "^open education", "i") .<br />
?projectID jisc:short-name ?Project .<br />
?techRelation doap:Project ?projectID .<br />
?techRelation prod:technology ?TechnologyID .<br />
FILTER regex(str(?TechnologyID), "^http://prod.cetis.ac.uk/standard/")  .<br />
?TechnologyID rdfs:label ?Standards .<br />
OPTIONAL { ?techRelation prod:comment ?Comments } .<br />
}</p></blockquote>
<p>From this I created a pivot table of all standards, and how much they appeared in each projects and programmes for each year (using the project start date). After importing this into R, it took two lines to grab the google visualisation package and plot this as Google Visualisation Chart.</p>
<blockquote><p>library("googleVis")<br />
M = gvisMotionChart(data=prod_csv, idvar="Standards", timevar="Year", chartid="Standards")</p></blockquote>
<p>Which gives you the 'Hans Rosling' style flow chart. I can't get this to embed in my wordpress blog, but you can click the diagram to view the interaction version. The higher up a standard is the more projects it is in and the further across it goes the more programmes it spans.</p>
<p><a href="http://galadriel.cetis.ac.uk/david/tmp.html"><img class="aligncenter size-full wp-image-273" title="Google Visualisation Chart" src="http://blogs.cetis.ac.uk/david/files/2012/02/hr.png" alt="Google Visualisation Chart" width="639" height="514" /></a></p>
<p>Some things it made me think about:</p>
<ol>
<li>Data from PROD is inconsistent</li>
<p>Standards can be spelt differently; some programmes/projects might have had a more time spent on inputting related standards than others</p>
<li>How useful is it?</li>
<p>This was extremely easy to do, but is it worth doing? I feel it has value for me because its made me think about the way JISC CETIS staff use PROD and the sort of data we input. Would this be of value to anybody else?  Although it was interesting to see the high number of projects across three programmes that involved XCRI in 2008.</p>
<li>Do we need all that data?</li>
<p>There are a lot of standards represented in the visualisation. Do we need them all? Can we concentrate on subsets of this data.</ol>
]]></content:encoded>
			<wfw:commentRss>http://blogs.cetis.ac.uk/david/2012/02/01/using-r-to-visualise-standards-in-prod/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Getting data out of PROD and its triplestore</title>
		<link>http://blogs.cetis.ac.uk/david/2012/01/30/getting-useful-data-out-of-prod-and-its-linked-data-store/</link>
		<comments>http://blogs.cetis.ac.uk/david/2012/01/30/getting-useful-data-out-of-prod-and-its-linked-data-store/#comments</comments>
		<pubDate>Mon, 30 Jan 2012 12:06:57 +0000</pubDate>
		<dc:creator>dms2ect</dc:creator>
		
		<category><![CDATA[data visualisation]]></category>

		<guid isPermaLink="false">http://blogs.cetis.ac.uk/david/?p=249</guid>
		<description><![CDATA[For a while I have been wondering about the best way of creating a how-to guide around getting data out of the JISC CETIS project directory and in particular around its linked data triple store. A few weeks ago Martin Hawksy posted some great examples of work he’s been doing, including maps using data generated [...]]]></description>
			<content:encoded><![CDATA[<p>For a while I have been wondering about the best way of creating a how-to guide around getting data out of the <a href="http://prod.cetis.ac.uk">JISC CETIS project directory</a> and in particular around its linked data triple store. A few weeks ago <a href="http://mashe.hawksey.info/2012/01/oer-visualisation-project-maps-maps-maps-maps-day-20/">Martin Hawksy posted </a>some great examples of work he’s been doing, including maps using data generated by PROD, I think these examples are great and thought that they would be a good starting point for a how to guide.</p>
<p>Don’t be put off by scary terms as I think these things are relatively easy to do and I’ve left out as much technobabble as possible, The difficulty really lies with knowing both the location of various resources and some useful tricks. I’ve split the instructions into 3 steps.</p>
<ol>
<li><span> </span>Getting data out PROD in a Google Spreadsheet</li>
<li><span> </span>Getting Institution, Long and Lat data out of PROD</li>
<li><span> </span>Mapping with Google maps.</li>
</ol>
<p>The  steps currently live in a Google Doc while I update them. I’ve also created short screen casts of me following the instructions in case anybody get lost. Hopefully from here you have built up enough confidence to edit the queries for different results, the Google Spreadsheet Mapper to change the look and feel of your map or explore some the technologies behind the techniques.</p>
<p>You'll want the Step By Step Guide and you can see Sheila's example in her post here.</p>
<h2>Obtain Data from PROD (via Talis store) to populate a google doc</h2>
<a href="http://blogs.cetis.ac.uk/david/2012/01/30/getting-useful-data-out-of-prod-and-its-linked-data-store/"><p><em>Click here to view the embedded video.</em></p></a>
<h2>Getting Prod Project Data w/ Long Lat Data into Google Spreadsheet</h2>
<a href="http://blogs.cetis.ac.uk/david/2012/01/30/getting-useful-data-out-of-prod-and-its-linked-data-store/"><p><em>Click here to view the embedded video.</em></p></a>
<h2>Mapping PROD Data with Google Maps</h2>
<a href="http://blogs.cetis.ac.uk/david/2012/01/30/getting-useful-data-out-of-prod-and-its-linked-data-store/"><p><em>Click here to view the embedded video.</em></p></a>
]]></content:encoded>
			<wfw:commentRss>http://blogs.cetis.ac.uk/david/2012/01/30/getting-useful-data-out-of-prod-and-its-linked-data-store/feed/</wfw:commentRss>
		</item>
	</channel>
</rss>
