Last Friday I was at the National e-Science Centre (NeSC) for the second day of a workshop on e-Science; unfortunately I wasn’t able to get to the first day. I tweeted most of it with the Twitter hashtag #eresearch, so you might learn all you need to just be searching for that hashtag (although it is used for other things, especially by some of the Australians involved in ANDS). One thing I did like was the use of e-Science quite generally, without a specific focus on any one technology (ie it was not GRID-dominated!). However, that does it make it a little harder to define the e-Science bit.
Leif Laaksonen from Helsinki, Chair of the e-Infrastructure Reflection Group, gave the keynote (not sure if, or when, the slides will be made available). The e-IRG prepares white papers and other documents aiming to realise the “vision for the future […] an open e-Infrastructure enabling flexible cooperation and optimal use of all electronically available resources”. He mentioned the European Strategy Forum on Research Infrastructures (ESFRI); this group must be doing something right, as apparently they have 10 billion Euros to play with to build and maintain this infrastructure! He spoke quite a lot about sustainability, but it appeared that this means not paying for infrastructure through a succession of European projects, but rather through sustained funding through national governments. Hmmm. I wondered what happened when a country has a bad budget year and cuts its infrastructure project; how much of the global infrastructure can be damaged by that?
Laaksonen had a number of interesting diagrams in his presentation, which can be seen from the web site. One that alarmed me (slide 17?) had an un-differentiated layer of “data” just above the network layer. I worry that is a dangerously simplistic summary; the data layer is far more fractured than that, with disciplinary, sub-disciplinary, even sub-group different approaches to curation.
Laaksonen did show a great slide, dating from 2003, showing routes of innovation from academic research to industrial acceptance. Not a monotonic progress!
This was followed by 3 quick presentations, one on the National Grid Service (not the one that supplies electricity and gas, but the one that supplies compute and data storage resources, using, yes, GRID technologies. The second was on OMII-UK, aiming to sustain community software developments, but itself, like the DCC, perhaps facing its own sustainability crisis? Finally, I gave a short presentation on the DCC, based on the one I gave to the environmental data managers a month or so ago. Then Bruce Beckles from Cambridge gave a wonderfully enthusiastic talk on being a one-man support service for e-Science within the Cambridge IT infrastructure.
After an hour-long panel session (no notes as I was on the panel; there was quite a focus on data, and on education & training), and lunch, there was an interesting demo session in the afternoon. This was organised so that each demo was given twice, and there were 3 sessions of 20 minutes each, so you could see quite a lot. I took in a Taverna demo (workflows, which I've wanted to understand better for some time), found I was the sole person in the second demo on NaCTeM (which meant I could ask all the text mining questions I wanted), and then saw the e-Science Central demo. Disappointing that the latter invented their own workflow system, although they claim there were good reasons, and they are hoping to backstitch Taverna in later (@lescarr tweeted back to me that their site doesn't use UTF-encodings, so if you hover over their rather nice cartoon images, the captions come up all wonky!).
Finally the wrap-up session, chaired by David de Roure (not as advertised). We were meant to find “just 3 things” that needed to be done to move e-Science more firmly into the national infrastructure. But of course our enthusiasm got the better of us, and we couldn’t stop. I think David and Malcolm Atkinson between them have the job of winnowing it down to the 3 top priorities. Altogether, a very interesting day; it’s good to see data becoming a real priority in e-Science!
Showing posts with label eScience. Show all posts
Showing posts with label eScience. Show all posts
Sunday, 19 April 2009
Friday, 14 November 2008
DCC White Rose day
Fresh from a fascinating day in Sheffield, organised by the DCC and the White Rose e-Science folk. Objectives for the day included building closer relationships between White Rose and DCC, helping us learn more about their approach to e-Science, identify data issues, and influence the DCC agenda!
After introductory remarks, the day started with Martin Lewis, Sheffield Librarian, talking about the UK Research Data Service (UKRDS) feasibility study. Martin was keen to emphasise the last two words; it’s important to manage expectations here, and we’re a long way from an operational service. There’ll be a conference to discuss the detailed proposals in February 2009, after which they hope to get funding for several Pathfinder projects. Martin and I argued ferociously, as we always do, but I should be clear that this has the potential to be an extremely valuable development. The really difficult conundrum is getting the balance of sustainability, scalability, persistence and domain science involvement in the curation. Oh, plus an appealing pitch to the potential funders. Not at all an easy balance!
Then we heard from Dr Darren Treanor from Leeds about their virtual slide library for histopathology; he claims it as one of the largest in the world, with over 40K slides digitised, even if only a thousand or so are fully described and publicly available. At 10 Gb or more a slide, these are not small; not just storage but bandwidth becomes a very real issue when accessing them. We had a brief discussion about technologies that optimise bandwidth for view very large or high resolution images; think Google Earth as one example, or the amazing Seadragon, created by Blaise Aguera y Arcas and now owned by Microsoft (the technology appears to be incorporated into Photosynth, but I can’t explore it, as it doesn’t work in my OS!).
Sarah Jones from the DCC and HATII at Glasgow spoke about the Data Audit Framework, now being piloted at 4 sites. This is a tool aimed at helping institutions to discover their research data resources, and begin to understand the extent to which they are at risk. More about that one later, I think!
Then we heard about 3 more very different projects, although Virtual Vellum probably had more in common with the virtual slide library than the presenter would have previously expected. This project shows digitised and cleaned up medieval manuscripts, with their TEI-based transcription in parallel. We heard an entertaining rant against SRB (wrong tool for the job, I think), but more worryingly that these projects were strongly constrained by IPR problems (yes, the digitised versions of half-millennium-old manuscripts do acquire new copyright status, and can also be ringed about with contractual restrictions). So much for open scholarship!
We also heard about the CARMEN project, aiming to support sharing and collaboration in neuroscience. Graham Pryor will be releasing a report from his involvement with CARMEN before too long, so I won’t dwell on it, other than to say it is a really good project that has thought a lot of issues through very carefully. It also has one decent and one cringeworthy acronym: MINI, for the Minimum Information for a Neuroscience Investigation, and MIAOWS, for Minimum Information About a Web Service… but maybe Frank Gibson was pulling our legs, since I didn’t find it on a Google search, nor is it in the MIBBI (Minimum Information for Biological and Biomedical Investigations) Portal!
Finally we heard about the University of York Digital Library developments; this is not so much a project as the development phases of a service. They've choesn Fedora plus Muradora as their technology platform, but it was clear again that this was a thoughtful project, recognising that there's much more to it than "build it and they will come".
This was a really interesting day; I hope we gave good value; I certainly learned a lot. Thanks everyone, especially Dr Joanna Schmidt, who organised it with Martin Donnelly.
After introductory remarks, the day started with Martin Lewis, Sheffield Librarian, talking about the UK Research Data Service (UKRDS) feasibility study. Martin was keen to emphasise the last two words; it’s important to manage expectations here, and we’re a long way from an operational service. There’ll be a conference to discuss the detailed proposals in February 2009, after which they hope to get funding for several Pathfinder projects. Martin and I argued ferociously, as we always do, but I should be clear that this has the potential to be an extremely valuable development. The really difficult conundrum is getting the balance of sustainability, scalability, persistence and domain science involvement in the curation. Oh, plus an appealing pitch to the potential funders. Not at all an easy balance!
Then we heard from Dr Darren Treanor from Leeds about their virtual slide library for histopathology; he claims it as one of the largest in the world, with over 40K slides digitised, even if only a thousand or so are fully described and publicly available. At 10 Gb or more a slide, these are not small; not just storage but bandwidth becomes a very real issue when accessing them. We had a brief discussion about technologies that optimise bandwidth for view very large or high resolution images; think Google Earth as one example, or the amazing Seadragon, created by Blaise Aguera y Arcas and now owned by Microsoft (the technology appears to be incorporated into Photosynth, but I can’t explore it, as it doesn’t work in my OS!).
Sarah Jones from the DCC and HATII at Glasgow spoke about the Data Audit Framework, now being piloted at 4 sites. This is a tool aimed at helping institutions to discover their research data resources, and begin to understand the extent to which they are at risk. More about that one later, I think!
Then we heard about 3 more very different projects, although Virtual Vellum probably had more in common with the virtual slide library than the presenter would have previously expected. This project shows digitised and cleaned up medieval manuscripts, with their TEI-based transcription in parallel. We heard an entertaining rant against SRB (wrong tool for the job, I think), but more worryingly that these projects were strongly constrained by IPR problems (yes, the digitised versions of half-millennium-old manuscripts do acquire new copyright status, and can also be ringed about with contractual restrictions). So much for open scholarship!
We also heard about the CARMEN project, aiming to support sharing and collaboration in neuroscience. Graham Pryor will be releasing a report from his involvement with CARMEN before too long, so I won’t dwell on it, other than to say it is a really good project that has thought a lot of issues through very carefully. It also has one decent and one cringeworthy acronym: MINI, for the Minimum Information for a Neuroscience Investigation, and MIAOWS, for Minimum Information About a Web Service… but maybe Frank Gibson was pulling our legs, since I didn’t find it on a Google search, nor is it in the MIBBI (Minimum Information for Biological and Biomedical Investigations) Portal!
Finally we heard about the University of York Digital Library developments; this is not so much a project as the development phases of a service. They've choesn Fedora plus Muradora as their technology platform, but it was clear again that this was a thoughtful project, recognising that there's much more to it than "build it and they will come".
This was a really interesting day; I hope we gave good value; I certainly learned a lot. Thanks everyone, especially Dr Joanna Schmidt, who organised it with Martin Donnelly.
Labels:
Curation,
Data,
Data audit,
eScience,
Repositories
Wednesday, 24 September 2008
Data as major component of national research collaboration
This is perhaps the last of my posts resulting from conversations and presentations at the UK e-Science All Hands meeting in Edinburgh. This one relates to Andrew Treloar’s presentation on the Australian National Data Service (ANDS), and its over-arching programme, Platforms for Collaboration, part of the National Collaborative Research Infrastructure Strategy.
There are strong historical reasons why collaboration over a distance is very important for Universities and researchers in Australia. Now the Government seems to have really got the message, with this major investment programme. Andrew described how a basis of improving the basic infrastructure (network and access management) supports 3 programmes, high performance computing, collaboration services, and the Data Commons. The first two of these are equally important, but in from my vantage, I’m particularly interested in the Data Commons.
The latter is provided (or perhaps supported; it’s highly distributed) by ANDS. The first business plan for ANDS is available at http://ands.org.au/andsinterimbusinessplan-final.pdf and will run until July 2009, with ANDS itself expected to run to 2011. The vision for ANDS is in the document “Towards the Australian Data Commons”.
The vision document :
ARCHER, mentioned earlier, provides candidate technology for an institution participating in ANDS. As Andrew pointed out in a comment responding to my confusion in the last post: “the CCLRC [metadata] schema is the internal schema being use by ARCHER to manage all of the metadata associated with the experimental data. ISO2146 is the schema being used by ANDS to develop its discovery service”. No doubt there are many ways institutional nodes can and will be stitched together, and it will be interesting to see how this develops.
Australians sometimes bemoan the lack of an Australian equivalent of JISC. However, in this case they appear to have put together something with significant coherence in multiple dimensions. On the face of it, this is more significant than any European or US programme I have seen so far. A lot depends on the execution, but with good luck and a following wind (and a fairly strong dose of “suspension of disbelief” from researchers), this could well turn out to be a world-beating data infrastructure programme.
For comparison, I’ll try to take a look at the emerging UK Research Data Service proposals, shortly. Perhaps that has the opportunity to be even better?
There are strong historical reasons why collaboration over a distance is very important for Universities and researchers in Australia. Now the Government seems to have really got the message, with this major investment programme. Andrew described how a basis of improving the basic infrastructure (network and access management) supports 3 programmes, high performance computing, collaboration services, and the Data Commons. The first two of these are equally important, but in from my vantage, I’m particularly interested in the Data Commons.
The latter is provided (or perhaps supported; it’s highly distributed) by ANDS. The first business plan for ANDS is available at http://ands.org.au/andsinterimbusinessplan-final.pdf and will run until July 2009, with ANDS itself expected to run to 2011. The vision for ANDS is in the document “Towards the Australian Data Commons”.
The vision document :
"...identifies a number of longer term objectives for data management:Andrew writes:
- A. A national data management environment exists in which Australia’s research data reside in a cohesive network of research repositories within an Australian ‘data commons’.
- B. Australian researchers and research data managers are ‘best of breed’ in creating, managing, and sharing research data under well formed and maintained data management policies.
- C. Significantly more Australian research data is routinely deposited into stable, accessible and sustainable data management and preservation environments.
- D. Significantly more people have relevant expertise in data management across research communities and research managing institutions.
- E. Researchers can find and access any relevant data in the Australian ‘data commons’.
- F. Australian researchers are able to discover, exchange, reuse and combine data from other researchers and other domains within their own research in new ways.
- G. Australia is able to share data easily and seamlessly to support international and nationally distributed multidisciplinary research teams. (p. 6) "
“ANDS has been structured as four inter-related and co-ordinated service delivery programs:Andrew also mentioned the Science and Research Strategic Roadmap Review, published just this August, which seems to centre on NCRIS. This includes the notion of a” national data fabric”, based on institutional nodes.
- Developing Frameworks [Monash]
- Providing Utilities [ANU]
- Seeding the Commons [Monash]
- Building Capabilities” [ANU]
ARCHER, mentioned earlier, provides candidate technology for an institution participating in ANDS. As Andrew pointed out in a comment responding to my confusion in the last post: “the CCLRC [metadata] schema is the internal schema being use by ARCHER to manage all of the metadata associated with the experimental data. ISO2146 is the schema being used by ANDS to develop its discovery service”. No doubt there are many ways institutional nodes can and will be stitched together, and it will be interesting to see how this develops.
Australians sometimes bemoan the lack of an Australian equivalent of JISC. However, in this case they appear to have put together something with significant coherence in multiple dimensions. On the face of it, this is more significant than any European or US programme I have seen so far. A lot depends on the execution, but with good luck and a following wind (and a fairly strong dose of “suspension of disbelief” from researchers), this could well turn out to be a world-beating data infrastructure programme.
For comparison, I’ll try to take a look at the emerging UK Research Data Service proposals, shortly. Perhaps that has the opportunity to be even better?
Labels:
Curation,
Digital Curation,
eScience,
Repositories,
Research data
Friday, 19 September 2008
ARCHER: a component of Australian e-Research infrastructure?
At the e-Science All Hands meeting, David Groenewegen from Monash spoke (PPT, also from Nick Nicholas and Anthony Beitz) about the outputs of the ARCHER project, almost finished, intended to provide tools for e-Research infrastructure. They see these e-Research challenges:

This does look to me like the metadata for a Current Research Information System (CRIS); I've spoken of these before. Maybe the CERIF metadata might do a similar job? Later we heard that the ANDS programme was to use yet another metadata set or standard (ISO2146); OK guys, I got a bit confused at this point!
Clearly this is a generic system; they also have some customisations coming for crystallographers, including the wonderfully-named TARDIS (The Australian Repositories for Diffraction Images). It's not yet clear to me how domain science curation and domain-specific metadat fit into this model, but I hope to find out more next month.
So where next for ARCHER? David wrote:
(I think ARCHER is a collaboration of ANU, James Cook, Monash and Queensland Universities.)
- "Acquiring data from instruments
- Storing and managing large quantities of data
- Processing large quantities of data
- Sharing research resources and work spaces between institutions
- Publishing large datasets and related research artifacts
- Searching and discovering"
- "ARCHER Research Repository - for storing large datasets, based on SRB
- Distributed Integrated Multi-Sensor & Instrument Middleware – concurrent data capture and analysis
- Scientific Dataset Manager (Web) - for managing datasets
- Metadata Editing Tool
- Scientific Dataset Manager (Desktop) – for managing datasets
- Analysis Workflow Automation Tool - streamlining analysis
- Collaborative Workspace Development Tool - bringing researchers together"

This does look to me like the metadata for a Current Research Information System (CRIS); I've spoken of these before. Maybe the CERIF metadata might do a similar job? Later we heard that the ANDS programme was to use yet another metadata set or standard (ISO2146); OK guys, I got a bit confused at this point!
Clearly this is a generic system; they also have some customisations coming for crystallographers, including the wonderfully-named TARDIS (The Australian Repositories for Diffraction Images). It's not yet clear to me how domain science curation and domain-specific metadat fit into this model, but I hope to find out more next month.
So where next for ARCHER? David wrote:
- "Currently testing the tools for release by late September
- Some tools already out in the wild and in use
- Expecting that the partners will continue to develop the tools they created
- New enhanced versions already being worked on
- Looking at how these tools might be used within ANDS (Australian National Data Service) & ARCS (Australian Research Collaborative Service) and beyond!"
(I think ARCHER is a collaboration of ANU, James Cook, Monash and Queensland Universities.)
Labels:
Data Services,
eScience,
publishing,
Repositories
Monday, 15 September 2008
David de Roure on "the new e-Science"
I was at the eScience All Hands meeting last week, and unfortunately missed a presentation by David de Roure on the New e-Science, an update on a talk he gave 10 months ago. The slides are available on Slideshare, but David has agreed I can share his summary:
"1. Increasing scale and diversity of participationThe presentation is well worth looking at as well for the extra material David includes. I thought the more open and inclusive approach to e-Science (or Cyber-infrastructure) was well worth including here. The word "heroic" appears on his slides in relation to the Grid, which sums up my concerns, I think!
Decreasing cost of entry into digital research means more people, data, tools and methods. Anyone can participate: researchers in labs, archaeologists in digs or schoolchildren designing antimalarial drugs. Citizen science! Improved capabilities of digital research (e.g. increasing automation, ease of collaboration) incentivises this participation. "You're letting the oiks in!" people cry, but peer review benefits from scale of participation too. "Long Tail Science"
2. Increasing scale and diversity of data
Deluge due to new experimental methods (microarrays, combinatorial chemistry, sensor networks, earth observation, ...) and also (1). Increasing scale, diversity and complexity of digital material, processed separately and in combination. New digital artefacts like workflows, provenance, ontologies and lab books. Context and provenance essential for re-use, quality and trust. Digital Curation challenge!
3. Sharing
Anyone can play and they can play together. Anyone can be a publisher as well as a consumer - everyone's a first class citizen. Science has always been a social process, but now we're using new social tools for it. Evidenced by use of wikis, blogs, instant messaging. The lifecycle goes faster, we accelerate research and reduce time-to-experiment.
4. Collective Intelligence
Increasing participation means network effects through community intelligence: tagging, reviewing, discussion. Recommendation based on usage. This is in fact the only significant breakthrough in distributed systems in the last 30 years. Community curation: combat workflow decay!
5. Open Research
Publicly available data but also the open services and software tools of open science. Increasing adoption of Science Commons, open access journals, open data and linked data (formerly known as Semantic Web), PLoS, ... Open notebook science
6. Sharing Methods
Scripts, workflows, experimental plans, statistical models, ... Makes research repeatable, reproducible and reusable. Propagates expertise. Builds reputation. See Usefulchem, myExperiment.
7. Empowering researchers
Increasing facility with new tools puts the researchers in control - of their software/data apparatus and their experiments. Empowerment enables creativity and creation of new, sharable methods. Tools that take away autonomy will be resisted. Beware accidental disempowerment! Ultimately automation frees the researcher to do what they're best at, but can also be disempowering.
8. Better not perfect
Researchers will choose tools that are better than what they had before but not necessarily perfect. This force encourages bottom-up innovation in the practice of research. It opposes the adoption of over-engineered computer science solutions to problems researchers don't know they have and perhaps never will.
9. Pervasive deployment
Increasingly rich intersection between the physical and digital worlds through devices and instruments. Web-based interfaces not software downloads. Shift towards devices and the cloud. REST architecture coupling components that transcend their application.
10. Standing on the shoulders of giants
e-Science is now enabling researchers to do some completely new stuff! As the pieces become easy to use, researchers can bring them together in new ways and ask new questions. Boundaries are shifting, practice is changing. Ease of assembly and automation is essential."
Labels:
AHM08,
Curation,
Data,
Digital Curation,
eScience,
Research data,
Workflows
Wednesday, 20 August 2008
Adding value to data: eScience conference session
If you nearly had a paper ready for the International Digital Curation Conference in December (the closing date was the end of July), you may still have time to get one in to the special session "Adding value to data – Digital Repositories in the e-Science world" at the 4th IEEE International Conference on eScience, whose deadline has just been extended to 31 August. From the call for papers on the DReSNet blog:
"There is a great, untapped potential for synergies between grid/e-science technologies and a cluster of related systems addressing the management of digital assets in digital libraries and repositories. The digital material generated from and used by academic and other research is to an increasing extent being held in formal data management systems; these systems are variously categorized as digital repositories, libraries or archives, although the distinction between them relates more to the sort of data that they contain and the use to which the data is put, rather than to any major difference in functionality. In many cases, these systems are used currently to hold relatively simple objects, for example an institution’s pre-prints and publications, or e-theses. However, some institutions are beginning to use them to manage research data in a variety of disciplines, including physical sciences, social sciences, and the arts and humanities, as well as the output from various digitisation programmes."This does look very interesting. They suggest several research challenges, which I think tie in pretty much with our own agenda, although the last is novel to me in the way it's framed:
- Digital preservation and curation in research infrastructures
- Interoperability
- Security
- Provenance
- Metadata Extraction
- Workflow Integration
- Architecture of Participation
Labels:
adding value,
Conference,
Data,
Data Re-use,
eScience,
Repositories
Subscribe to:
Posts (Atom)