{"id":1759,"date":"2019-01-20T18:05:22","date_gmt":"2019-01-20T18:05:22","guid":{"rendered":"https:\/\/digiculture.eu\/wordpress\/?p=1759"},"modified":"2020-12-08T13:25:57","modified_gmt":"2020-12-08T11:25:57","slug":"output-6","status":"publish","type":"post","link":"https:\/\/digiculture.eu\/en\/output-6\/","title":{"rendered":"Output 6 – Evaluation of the effectiveness of Digital Skills for Culture Course, Quality Assurance and Sustainability"},"content":{"rendered":"

<\/a>O6  Evaluation of the effectiveness of Digital Skills for Culture Course, Quality Assurance and Sustainability<\/h1>\n

This output is concerned with the evaluation, quality assurance and sustainability of the project and its outcomes.<\/p>\n

The Evaluation strategy of Digital Skills for Culture is part of the socio-cognitive engineering methodology (Sharples, 2002) implemented throughout this project  and it is a continuing process. The evaluation will consist of different stages and will implemented at every output: evaluation of the concept and guidelines (O1),  testing VLH against its own requirements for usability (O2); evaluating the Course Curricula and Content against the needs of the target group (O3), evaluating the e-assessment tools for digital skills against their specific requirements (O4) and evaluating the effectiveness of the pilots in improving digital skills of the adults involved (O5) .<\/p>\n

Effectiveness is defined as meeting user goals. For  online learning, there are many tools and techniques that are used to evaluate effectiveness (Andone, 2012; Mosakhani, 2010).<\/p>\n

Evaluation of the effectiveness of the course and pilots will be conducted continuously and focus on dimensions directly affecting the effectiveness of MOOC: Interactivity, Collaboration, Pedagogy, Content, Technology, Usability, Motivation, Assessment and Support for Learners. A mix of qualitative and quantitative methods will be used to evaluate the effectiveness in order to better understand participants\u2019 perspectives on the effectiveness of MOOCs. These will include an online questionnaire as well as qualitative insights into their experience during the course through testimonials, interviews and focus groups. They will be corroborated with the results from the learning analytics report (O2) in order to create a full picture for the final evaluation report.<\/p>\n

The work in this output is divided into four activities – the Quality Assurance Framework (6.1), the overall Evaluation Framework (6.2),  the Effectiveness evaluation of the course and pilot (6.3) and the Sustainability plan (6.4). These activities are critical for ensuring the success of the project and will guide work not only within the partnership but also in relation to the wider cultural and heritage community, and to stakeholders from other domains interested in policy formation or implementation in adult education through sustainability of project results.<\/p>\n

This output applies concepts from innovation theory, such as the ‘community of innovation’ approach for defining the quality assurance framework and the ‘diffusion of innovation’ model for development of the Sustainability Plan (Rogers, 1995; von Hippel, 1985).<\/p>\n

Output Type: Methodologies \/ guidelines \u2013 Evaluation method and tool<\/p>\n

<\/a>O6.1  Quality Assurance Framework<\/h2>\n

This activity will defines a quality assurance framework for the implementation of the entire project and its components. Quality assurance is a crucial issue in the design of any learning intervention, but particularly so in the case of OERs, MOOCs and any form or open or distance education where students will be accessing materials without the guidance of a teacher.<\/p>\n

The methodology will include<\/p>\n

– the design of quality assurance standards for single components of the project (especially O1.2, O2.2, O4.1 and O5.3)<\/p>\n

– the design of quality assurance process for linking and integrating quality standards to all stages of development of intellectual outputs, e. g. by applying effective design and development methodology such as quality-driven agile development, peer-reviews of iterations and final outcomes as well as quality implementation process and possible corrective actions<\/p>\n

– bi-monthly evaluation of quality of work in the project and reports on findings to further the implementation of the project.<\/p>\n

Milestones:<\/p>\n

O6.1.1.Design of quality assurance standards<\/p>\n

O6.1.2. Design of the quality assurance process<\/p>\n

O6.1.3. Design of evaluation instruments and periodical progress reports to guide project implementation<\/p>\n

Leading:  JMEA<\/p>\n

Participating: all<\/p>\n

<\/a>O6.2  Evaluation Framework<\/h2>\n

Unlike QA which is ongoing, project evaluation is episodic, and will need to be conducted both at the end of the project and at key stages during the project (especially O2.5, O3.4, O5.3 and O5.4). It will use both internally collected data and compare it against information from other resources.<\/p>\n

Evaluation will be conducted at the end of each intervention involving outside parties from the target groups that the project is designed to help (O5.2, O5.3 and O5.4).<\/p>\n

Evaluation will be conducted using face to face interviews and focus groups during project meetings and other interventions, and by means of online tools (surveys) for larger samples.<\/p>\n

Final evaluation at the end of the project will include if the project cost effective, if it can be scaled up and replicated elsewhere, and if it is self-sustaining.<\/p>\n

For the final evaluation, the project may employ a consultant or outside organisation to provide a fresh perspective on its achievements.<\/p>\n

Milestones:<\/p>\n

O6.2.1 Identification of evaluation episodes<\/p>\n

O6.2.2 Design of quantitative evaluation tools<\/p>\n

O6.2.3 Design of qualitative evaluation tools<\/p>\n

O6.2.4 Design and implementation of final evaluation<\/p>\n

Leading:  JMEA<\/p>\n

Participating: all<\/p>\n

<\/a>O6.3  Effectiveness of the Digital Skills for Culture Course<\/h2>\n

To evaluate the course and pilot based on the socio-engineering method, we will also use a mixture of qualitative and quantitative methods in order to both evaluate the course and gather participants\u2019 perspective on the effectiveness of MOOCs more generally (O3.4 and O3.5). This will make use of an online questionnaire with a variety of question types, together with the use of qualitative tools to gather views on experience during the course, including testimonials, interviews and focus group. The evaluation will be run on all partners\u2019 courses, and in all languages for both fully online and blended learning implementations. The final target is to evaluate and validate which of the teaching methods used (fully online or blended-learning) is more appropriate to deliver adult education for the improvement of digital skills.<\/p>\n

Milestones:<\/p>\n

O.6.3.1. Design of evaluation plan for the Digital Skills course<\/p>\n

O6..3.2  Implementation of Quantitative Evaluation<\/p>\n

O.6.3.3. Implementation of Qualitative Evaluation<\/p>\n

O.6.3.4. The Evaluation Report<\/p>\n

Leading:  JMEA<\/p>\n

Participating: all<\/p>\n

<\/a>O6.4  Sustainability Plan<\/h2>\n

This activity focuses on the development of a sustainability plan for the project results beyond the project lifetime including the integration into national and EU policies. The methodology used is based on relevant concepts from innovation theory, including  the diffusion of innovation and the adoption of innovation models.<\/p>\n

Validation of the strategy will be achieved through various methods such as surveys, workshops and public meetings. The final sustainability plan will focus on leadership, objectives, strategies, outreach and activities. The sustainability plan will be developed in close connection with the quality assurance plan and with the involvement of key policy organisations inside and outside the partnership such as TM2021, EDEN, Rijeka2020, NoviSad2021, Kaunas2022, Italian Fondazione Idis-Citt\u00e0 della Scienza, Foundation InterArt Triade, Foundation ArtEncounters, European Architects Association, Network of European Museum Organisations (NEMO), etc.<\/p>\n

Milestones:<\/p>\n

6.4.1 Design of Sustainability Plan<\/p>\n

6.4.2 Dissemination of Plan within the partnership<\/p>\n

6.4.3 Dissemination of Plan with outside organisations<\/p>\n

Leading:  JMEA<\/p>\n

Participating: all<\/p>\n","protected":false},"excerpt":{"rendered":"

<\/a>O6\u00a0 Evaluation of the effectiveness of Digital Skills for Culture Course, Quality Assurance and Sustainability<\/h1>\n

This output is concerned with the evaluation, quality assurance and sustainability of the project and…Read More →<\/a><\/span><\/p>\n","protected":false},"author":5,"featured_media":1772,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":"","_wpscppro_dont_share_socialmedia":false,"_wpscppro_custom_social_share_image":0},"categories":[111,99],"tags":[],"yoast_head":"\nOutput 6 - Evaluation of the effectiveness of Digital Skills for Culture Course, Quality Assurance and Sustainability - Digital Culture - Erasmus+ European Project<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/digiculture.eu\/en\/output-6\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Output 6 - Evaluation of the effectiveness of Digital Skills for Culture Course, Quality Assurance and Sustainability - Digital Culture - Erasmus+ European Project\" \/>\n<meta property=\"og:description\" content=\"O6\u00a0 Evaluation of the effectiveness of Digital Skills for Culture Course, Quality Assurance and Sustainability This output is concerned with the evaluation, quality assurance and sustainability of the project and...Read More →\" \/>\n<meta property=\"og:url\" content=\"https:\/\/digiculture.eu\/en\/output-6\/\" \/>\n<meta property=\"og:site_name\" content=\"Digital Culture - Erasmus+ European Project\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/CultureDigi\" \/>\n<meta property=\"article:published_time\" content=\"2019-01-20T18:05:22+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-12-08T11:25:57+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/digiculture.eu\/wp-content\/uploads\/2019\/01\/business-businesswoman-career-39519.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"3008\" \/>\n\t<meta property=\"og:image:height\" content=\"2000\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"DigiCulture\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@elearning_upt\" \/>\n<meta name=\"twitter:site\" content=\"@elearning_upt\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"DigiCulture\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/digiculture.eu\/output-6\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/digiculture.eu\/output-6\/\"},\"author\":{\"name\":\"DigiCulture\",\"@id\":\"https:\/\/digiculture.eu\/#\/schema\/person\/1d9da190a16f395930c0defc1abc649d\"},\"headline\":\"Output 6 – Evaluation of the effectiveness of Digital Skills for Culture Course, Quality Assurance and Sustainability\",\"datePublished\":\"2019-01-20T18:05:22+00:00\",\"dateModified\":\"2020-12-08T11:25:57+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/digiculture.eu\/output-6\/\"},\"wordCount\":1120,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/digiculture.eu\/#organization\"},\"articleSection\":[\"Output 6 -Evaluation of the effectiveness of Digital Skills for Culture Course, Quality Assurance\",\"Outputs\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/digiculture.eu\/output-6\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/digiculture.eu\/output-6\/\",\"url\":\"https:\/\/digiculture.eu\/output-6\/\",\"name\":\"Output 6 - Evaluation of the effectiveness of Digital Skills for Culture Course, Quality Assurance and Sustainability - Digital Culture - Erasmus+ European Project\",\"isPartOf\":{\"@id\":\"https:\/\/digiculture.eu\/#website\"},\"datePublished\":\"2019-01-20T18:05:22+00:00\",\"dateModified\":\"2020-12-08T11:25:57+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/digiculture.eu\/output-6\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/digiculture.eu\/output-6\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/digiculture.eu\/output-6\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/digiculture.eu\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Output 6 – Evaluation of the effectiveness of Digital Skills for Culture Course, Quality Assurance and Sustainability\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/digiculture.eu\/#website\",\"url\":\"https:\/\/digiculture.eu\/\",\"name\":\"Digital Culture - Erasmus+ European Project\",\"description\":\"Improving the Digital Competences and Social Inclusion of Adults in Creative Industries\",\"publisher\":{\"@id\":\"https:\/\/digiculture.eu\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/digiculture.eu\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/digiculture.eu\/#organization\",\"name\":\"Digiculture\",\"url\":\"https:\/\/digiculture.eu\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/digiculture.eu\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/digiculture.eu\/wp-content\/uploads\/2019\/01\/Logo-Digi-Culture.png\",\"contentUrl\":\"https:\/\/digiculture.eu\/wp-content\/uploads\/2019\/01\/Logo-Digi-Culture.png\",\"width\":934,\"height\":386,\"caption\":\"Digiculture\"},\"image\":{\"@id\":\"https:\/\/digiculture.eu\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/CultureDigi\",\"https:\/\/twitter.com\/elearning_upt\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/digiculture.eu\/#\/schema\/person\/1d9da190a16f395930c0defc1abc649d\",\"name\":\"DigiCulture\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/digiculture.eu\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/437e79a797105729bdb90a0a9148a840?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/437e79a797105729bdb90a0a9148a840?s=96&d=mm&r=g\",\"caption\":\"DigiCulture\"},\"url\":\"https:\/\/digiculture.eu\/en\/author\/silviuvert\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Output 6 - Evaluation of the effectiveness of Digital Skills for Culture Course, Quality Assurance and Sustainability - Digital Culture - Erasmus+ European Project","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/digiculture.eu\/en\/output-6\/","og_locale":"en_US","og_type":"article","og_title":"Output 6 - Evaluation of the effectiveness of Digital Skills for Culture Course, Quality Assurance and Sustainability - Digital Culture - Erasmus+ European Project","og_description":"O6\u00a0 Evaluation of the effectiveness of Digital Skills for Culture Course, Quality Assurance and Sustainability This output is concerned with the evaluation, quality assurance and sustainability of the project and...Read More →","og_url":"https:\/\/digiculture.eu\/en\/output-6\/","og_site_name":"Digital Culture - Erasmus+ European Project","article_publisher":"https:\/\/www.facebook.com\/CultureDigi","article_published_time":"2019-01-20T18:05:22+00:00","article_modified_time":"2020-12-08T11:25:57+00:00","og_image":[{"width":3008,"height":2000,"url":"https:\/\/digiculture.eu\/wp-content\/uploads\/2019\/01\/business-businesswoman-career-39519.jpg","type":"image\/jpeg"}],"author":"DigiCulture","twitter_card":"summary_large_image","twitter_creator":"@elearning_upt","twitter_site":"@elearning_upt","twitter_misc":{"Written by":"DigiCulture","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/digiculture.eu\/output-6\/#article","isPartOf":{"@id":"https:\/\/digiculture.eu\/output-6\/"},"author":{"name":"DigiCulture","@id":"https:\/\/digiculture.eu\/#\/schema\/person\/1d9da190a16f395930c0defc1abc649d"},"headline":"Output 6 – Evaluation of the effectiveness of Digital Skills for Culture Course, Quality Assurance and Sustainability","datePublished":"2019-01-20T18:05:22+00:00","dateModified":"2020-12-08T11:25:57+00:00","mainEntityOfPage":{"@id":"https:\/\/digiculture.eu\/output-6\/"},"wordCount":1120,"commentCount":0,"publisher":{"@id":"https:\/\/digiculture.eu\/#organization"},"articleSection":["Output 6 -Evaluation of the effectiveness of Digital Skills for Culture Course, Quality Assurance","Outputs"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/digiculture.eu\/output-6\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/digiculture.eu\/output-6\/","url":"https:\/\/digiculture.eu\/output-6\/","name":"Output 6 - Evaluation of the effectiveness of Digital Skills for Culture Course, Quality Assurance and Sustainability - Digital Culture - Erasmus+ European Project","isPartOf":{"@id":"https:\/\/digiculture.eu\/#website"},"datePublished":"2019-01-20T18:05:22+00:00","dateModified":"2020-12-08T11:25:57+00:00","breadcrumb":{"@id":"https:\/\/digiculture.eu\/output-6\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/digiculture.eu\/output-6\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/digiculture.eu\/output-6\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/digiculture.eu\/"},{"@type":"ListItem","position":2,"name":"Output 6 – Evaluation of the effectiveness of Digital Skills for Culture Course, Quality Assurance and Sustainability"}]},{"@type":"WebSite","@id":"https:\/\/digiculture.eu\/#website","url":"https:\/\/digiculture.eu\/","name":"Digital Culture - Erasmus+ European Project","description":"Improving the Digital Competences and Social Inclusion of Adults in Creative Industries","publisher":{"@id":"https:\/\/digiculture.eu\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/digiculture.eu\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/digiculture.eu\/#organization","name":"Digiculture","url":"https:\/\/digiculture.eu\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/digiculture.eu\/#\/schema\/logo\/image\/","url":"https:\/\/digiculture.eu\/wp-content\/uploads\/2019\/01\/Logo-Digi-Culture.png","contentUrl":"https:\/\/digiculture.eu\/wp-content\/uploads\/2019\/01\/Logo-Digi-Culture.png","width":934,"height":386,"caption":"Digiculture"},"image":{"@id":"https:\/\/digiculture.eu\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/CultureDigi","https:\/\/twitter.com\/elearning_upt"]},{"@type":"Person","@id":"https:\/\/digiculture.eu\/#\/schema\/person\/1d9da190a16f395930c0defc1abc649d","name":"DigiCulture","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/digiculture.eu\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/437e79a797105729bdb90a0a9148a840?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/437e79a797105729bdb90a0a9148a840?s=96&d=mm&r=g","caption":"DigiCulture"},"url":"https:\/\/digiculture.eu\/en\/author\/silviuvert\/"}]}},"_links":{"self":[{"href":"https:\/\/digiculture.eu\/en\/wp-json\/wp\/v2\/posts\/1759"}],"collection":[{"href":"https:\/\/digiculture.eu\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/digiculture.eu\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/digiculture.eu\/en\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/digiculture.eu\/en\/wp-json\/wp\/v2\/comments?post=1759"}],"version-history":[{"count":4,"href":"https:\/\/digiculture.eu\/en\/wp-json\/wp\/v2\/posts\/1759\/revisions"}],"predecessor-version":[{"id":2619,"href":"https:\/\/digiculture.eu\/en\/wp-json\/wp\/v2\/posts\/1759\/revisions\/2619"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/digiculture.eu\/en\/wp-json\/wp\/v2\/media\/1772"}],"wp:attachment":[{"href":"https:\/\/digiculture.eu\/en\/wp-json\/wp\/v2\/media?parent=1759"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/digiculture.eu\/en\/wp-json\/wp\/v2\/categories?post=1759"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/digiculture.eu\/en\/wp-json\/wp\/v2\/tags?post=1759"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}