PROJECTS

ASSESSING AND DEVELOPING WORKPLACE ESSENTIAL SKILLS WITH ESAT – PHASE I & II    

May 2021

 

      

After being awarded a seed grant from the Future Skills Centre, an initial study into our Employability Skills Assessment Tool (ESAT) conducted by Futureworx and Blueprint allowed us to better understand how ESAT is used, how it is perceived by users, and the types of outcomes that would be expected and could feasibly be measured. The initial research, Phase 1, found that:  

  • Staff perceive positive outcomes for participants, especially related to improvements in self-awareness of social and emotional skills (S&E skills), S&E skills, and well-being.  
  • Staff identify several implementation factors as key to success: the importance of having staff buy-in, resourcing additional capacity for staff to dedicate toward ESAT use, including more than one perspective in the staff-assessment process, integrating S&E skills content across programming, and debriefing results with participants. 
  • There is ample variability in ESAT use and implementation, with some programs following Futureworx’ recommended approach, but many others that do not. 
  • Staff agree on many of ESAT’s core strengths for their participants, including that it is easy to use, helps staff establish a common language around employability skills, and eases tension during potentially difficult conversations with participants. 

 Based on the results of Phase I, The Future Skills Centre provided funding to conduct Phase II. 

 LEARNING GOALS: The learning goals of Phase II are: 

 Clearly define the minimum implementation conditions to maximize ESAT’s effectiveness 

  • Strengthen the current version of ESAT by applying some of staff’s suggestions from Phase I, and perform some light-touch validity testing   
  • Examine how ESAT is implemented across partner organizations to understand readiness factors, organizational barriers, and whether/why adaptations are made to implementation  
  • Examine which target populations are being reached and whether participants are satisfied 
  • Gather externally generated evidence for post-program outcomes (e.g., whether participants have better labour market outcomes) to compare these with ESAT scores; and 
  • Understand whether the ESAT is a valid measure of S&E skills 
  • Contribute to the evidence base on how to assess S&E skills, and how to validate a S&E skills assessment tool within a workforce development context 

TIME FRAME: Completion Sept 2023 

ACTIVITIES: The project activities include: 

Part A: Prepare for evaluation 

The approach to evaluation proposed for Phase II has several components and will therefore involve several preparation activities before evaluation activities can begin: 

  • Clearly define ideal conditions for implementation: Building on the ESAT User Guide, Futureworx will clearly outline the minimum implementation conditions for PDPs. 
  • Partner selection and onboarding: Futureworx will recruit and onboard program delivery partners (PDP) that are interested in taking part in the research and that meet all project requirements.  
  • Support refinements to the evaluation plan: Once partners are onboarded, Futureworx and Blueprint will work with partners to refine and adapt the evaluation plan laid out below.  

Part B: Strengthen ESAT 

Before ESAT is used within this research project, Futureworx will work with Blueprint to apply lessons learned from Phase I alongside some preliminary light-touch validity testing to improve self-assessment questions and exemplar descriptions. This will include the following activities:  

  • Create a Theory of Change (TOC): Ensure that the theories and assumptions underlying ESAT align with findings from Phase I and can be used to strengthen the tool.  
  • Support preliminary light-touch validity testing: Provide Blueprint with the ESAT assessment data required to test the correlation between individual items for each skill. 
  • Revise content of ESAT self-assessment questions and exemplar behaviours: Incorporate recommendations from Blueprint (based on validity testing and findings from Phase I) to revise the ESAT tool. 

Part C: Evaluate ESAT 

Three components of the evaluation will happen in tandem over the course of Phase II. 

Part C.1: Implementation supports and evaluation  

Futureworx and Blueprint will engage an external consultant with expertise in implementation science to support partners in tackling the delicate balance between delivering the program according to implementation requirements (i.e., fidelity of the model) and adaptations that are required for their context. Activities to be led by the implementation consultant and supported by both Futureworx and Blueprint will include: 

  • Readiness Assessment: Identifying and assessing factors that affect a PDP’s readiness for implementation  
  • Barriers and Facilitators Assessment: Assessing PDP’s perceptions of potential challenges and success factors that could be proactively mitigated or leveraged to improve evaluation results  
  • Tracking Fidelity and Adaptations: Understanding how ESAT is implemented across sites including whether and why adaptations are made 

Part C.2: Outcomes Evaluation  

This part of the evaluation will help us understand what outcomes are achieved by participants of each ESAT-using program and whether there is a relationship between ESAT scores and outcomes. Futureworx will lead or support Blueprint with the following activities: 

  • Define outcomes of interest: Identify the key participant outcomes to be tracked during the evaluation (e.g., improved skills, self-awareness, employment outcomes, education outcomes).  
  • Review data collection strategy and tools: Ensure that research instruments are accurately tailored to PDPs by providing feedback to Blueprint on surveys, interview protocols, etc.  
  • Support deployment of data collection strategy: Liaise between delivery partners and Blueprint to support the roll out and sequencing of all data collection.  

Part C.3: Process Evaluation   

The final component of the evaluation will help understand ESAT users’ experience with the tool, focusing primarily on the perceptions of participants and employers. Futureworx will support Blueprint with the following activities: 

  • Support design and deployment of a data collection strategy: Liaise between delivery partners and Blueprint to support interviews with partner staff, participants, and employers.  

Part D: Validity testing 

The final component of Phase II will involve a second, more robust round of validity testing, aiming to understand whether ESAT provides a valid measure of participants’ employability skills. Data collected during the evaluation will provide information on the necessary outcomes to make inferences about validity. Futureworx will support Blueprint as required with the following activities: 

  • Concurrent validity testing: Testing the extent to which ESAT is related to an existing, previously validated measure.  
  • Predictive validity testing: Testing the degree to which ESAT scores accurately predict desired outcomes.  
  • Inter-item reliability testing: Testing whether each revised question is aligned with the skill it seeks to measure.  

 PROGRAM DELIVERY PARTNERS: Futureworx is inviting existing and new ESAT users to participate in this project as program delivery partners (PDPs).  Funding supports and incentives will be provided to PDPs. Existing ESAT site managers can apply in ESAT. New users can apply by contacting Futureworx. 

CONTACT: For more information about, or to express interest in participating in this project, please Contact Paul Brinkhurst, Futureworx, 587-226-7800, paulb@futureworx.ca. 

______________________________________________________________________________________________________________________________________________________

Futureworx is proud to release its report – “Building a PAN CANADIAN SOFT SKILLS FRAMEWORK”

This project was funded to explore the need for, and how best to create, a pan-Canadian soft skills framework to support the development of a productive,
adaptable, globally competitive workforce capable of meeting the rapidly changing needs of work and the workplace.

Funded by the Government of Canada’s Adult Learning, Literacy and Essential Skills Program.

REPORT: Soft Skills Framework Report – PDF (5MB)

We welcome your feedback and questions – simply CONTACT US.

 


 

INTEGRATING SOFT SKILLS INTO THE ESSENTIAL SKILLS FRAMEWORK – BUILDING A NATIONAL CONSENSUS



OBJECTIVE: The objectives of this project are:

  • To develop a plan to create a common assessment and development approach for ‘soft’ skills in Canada;
  • To propose their integration into the existing essential skills framework;
  • To identify and develop common terminology.

These objectives will be achieved by:

  • Identifying existing ‘soft’ skills taxonomies, frameworks, efforts, assessments and resources being used and/or supported; and
  • Developing a plan for moving forward on a collaborative impact effort to expand the essential skills framework to include ‘soft’ skills.

TIME FRAME: Completion Nov 2018

ACTIVITIES: The project has four main activities:

  • Conduct a literature review of work on ‘soft’ skills across Canada to capture current thinking and efforts on ‘soft’ skill development;
  • Develop and implement a survey targeting a broad set of stakeholders across Canada (e.g. employers, service providers, educators, trainers, governments) to understand current practices, language, and views on ‘soft’ skills development;
  • Select a representative group of stakeholders (15-20), to be involved in a planning session to explore possibilities for the creation of a Canadian “soft skills” framework and its integration with the existing essential skills framework (stakeholders to be trained in consensus-based decision making and Collective Impact as part of the process); and
  • Write a report that summarizes the results from the project and providing recommendations for  reaching consensus on the development of a Canadian “soft skills” framework.

OUTPUTS: Principal outputs for the project include:

  • A summary of the existing ESDC Competency-based “soft” skills taxonomy;
  • An initial draft set of skills suited for initiating consensus discussions;
  • Recommendations for integrating “soft skills” into the existing essential skills framework;
  • A plan for developing a national consensus on ‘soft’ skills development and assessment;
  • Recommendations on how to render the taxonomy of practical use to front line application; and
  • A final report to ESDC.

FINAL REPORT: Final Report – Sharing Perspectives on Soft Skills Survey 06-11-2018 – PDF (427KB)

CONTACT: For more information about, or to express interest in participating in this project, please Contact Paul Brinkhurst, Futureworx, 587-226-7800, paulb@futureworx.ca.

Nova Scotia Works

Futureworx is now a Nova Scotia Works Employment Services Centre. We help job seekers and employers navigate a range of programs – from career planning, job searches and on-the-job development to recruitment, planning and HR support.

Employability Skills Assessment Tool

The Employability Skills Assessment Tool (ESAT) provides a framework and quantitative assessment methodology for the development of nine employability skills: motivation, attitude, accountability, time management, stress management, presentation, teamwork, adaptability and confidence.

7 days ago

Futureworx
A retirement is a special time to pause, reflect and remember. Barb Dyke, RN Educator at our Truro Campus on Glenwood Drive has retired after 14 impactful years! We want to take this opportunity to recognize her dedication and the heart-felt passion she brought to our Continuing Care Assistant Program, and the lasting mark she has made on our organization and the lives she has touched.As a community-based organization we recognize her positive contribution…. and on behalf of the Board of Directors, staff, and clients of Futureworx Society we thank her for 14 years of invaluable service! The impact on the organization as a whole is immeasurable.It has been an honour, a privilege, and a true pleasure to have worked with her over the years. ... See MoreSee Less
View on Facebook

1 week ago

Futureworx
OPPORTUNITY ALERT!We are actively hiring a Professional Development Instructor, with experience in curriculum development, to join our Futureworx Truro Campus team. The successful candidate will lend their instructional expertise and give recommendations to assist with the development of creative and innovative content for our employment focused training programs. Our goal is to be a diverse workforce that is representative, at all job levels, of the citizens we serve. We welcome applications from Aboriginal People, African Nova Scotians and Other Racially Visible Persons, Persons with Disabilities and Women in occupations or positions where they are under-represented. If you are a member of one of the equity groups, you are encouraged to self-identify, in your cover letter or on your resume.For more details about this REWARDING opportunity – please check out the full post at novascotiaworks.ca ... See MoreSee Less
View on Facebook

2 weeks ago

Futureworx
Pride Month is so important because it marks the start of huge change within the LGBTQ2 community, as well as the wider societal implications. It is a time when we celebrate diversity, acknowledge the history, the hardships they have endured, and the progress that has been made! By continuing in this long-standing tradition, we continue to raise awareness, improve the attitudes of society, and promote inclusiveness. #Pride2021 #pridemonth #inclusion #diversity #loveislove ... See MoreSee Less
View on Facebook

2 weeks ago

Futureworx
Our hearts are with the survivors, families, Indigenous Nations and all those affected by this tragedy. We can’t just mourn, we need to do more individually as settlers, and collectively as a country. We all have a part to play in Truth & Reconciliation. Take time to learn more through these important resources:➡️Centre for Truth and Reconciliation: nctr.ca/map.php➡️Learn about the Calls to Action: trc.ca/assets/pdf/Calls_to_Action_English2.pdf#EveryChildMatters #215Children #TruthAndReconciliation ... See MoreSee Less
View on Facebook

3 weeks ago

Futureworx
Incase you haven't heard, our Glenwood Drive location in Truro has undergone some significant improvements, not only interior cosmetic improvements - but a name change and program offering changes! Our Futureworx Truro Campus hosts new and improved 21 Week Employer-Focused Programs based on local employer demand in various industry sectors, such as:➡️ Hospitality➡️ Manufacturing ➡️ Food Services➡️ Retail For more information, or to speak to one of our dedicated staff eager to meet you and "Help You Realize Your Potential", check out their new Facebook page! ... See MoreSee Less
View on Facebook

▪️ Long-term care facilities closed to visitors effectively immediately
▪️ Public schools closed for two weeks following March Break; to be reassessed
▪️ Regulated childcare centres to be closed Mar 17 - April 3 then will be reassessed
▪️ March break camps cancelled
#COVID19NS

October is National Disability Employment Awareness Month and Futureworx (ESAT) is pleased to be one of the keynote speakers for the Distinctability Webinar series on Innovation and Assistive Technology. #innovation https://distinctability.ca/webinar-series/

What is it that a #CDP does? This #careermonth, take a moment to meet a #careerdevelopment professional in your area, and really feel supported as you strive to achieve your #career goals. https://careermonth.ca via @careermonth

First DEAM (Disability Employment Awareness Month) EVENT in Nova Scotia. Thank you @markwafer for speaking to our community partners this morning in Truro. @TEAMWork1997 #Inspire #Educate #InclusionMatters

Load More...

NSW Offices:
Truro - 902-893-6859
Elmsdale - 902-883-7010
Tatamagouche - 902-657-0180

Head Office:
14 Court Street, Suite 305
Truro, NS B2N 3H7

Tel: 902-843-4290
Fax: 902-843-4294

Hours:
Mon - Fri 8:30 am - 4:30 pm