View Project

G2S Project Code: 2016-KY-78147
State: Kentucky
Fiscal Year: 2016

Grantee
Kentucky Department for Libraries & Archives

Project Director
Director Name: Beth Milburn
Director Phone: 502-564-8325
Director Email: beth.milburn@ky.gov

General Information
Title: Five-Year Plan Evaluation and Plan
State Project Code: FY17042D
Start Date: 10/01/2015
End Date: 09/30/2017
Abstract: The Kentucky Department for Libraries and Archives sought to provide the Institute of Museum and Library Services (IMLS) with an independent evaluation of its 2013-2017 Five-Year Plan and a newly drafted 2018-2022 Five-Year Plan, as required by Section 9134 (c) of IMLS' authorizing legislation.
State Goal: Building Foundations for Sustainable Growth and Strength in Kentucky Libraries

Budget Information

LSTA

MATCH-State

MATCH-Other

Total

$44,500.00

$0.00

$44,500.00

Intent(s)
Improve library operations.
Research & Statistics

Activities
Activity Details
Title: Five-Year Plan - Evaluation-Retrospective
Narrative: Section 9134 (c) of IMLS' authorizing legislation directs State Library Administrative Agencies (SLAA's) to independently evaluate, and report to the Director regarding, the activities assisted under this subchapter, prior to the end of the five-year plan. After a competitive bidding process, KDLA contracted with QualityMetrics LLC to complete its Grants to States 2013-2017 LSTA Five-Year Plan Evaluation.

Quality Metrics examined three years of performance by KDLA in implementing its 2013-2017 LSTA Five Year Plan (Federal years 2013, 2014, and 2015). KDLA staff interviews, reports, documentation, websites, fliers, newspaper articles, and social media feeds were consulted as corroborating evidence. Additional data was obtained through a web survey of public libraries, a school library, bookmobile librarians, blind services, and a multi-type consortium. One virtual focus group session was held, in addition to four onsite focus group sessions conducted in different locations around the Commonwealth. Focus group sessions were held at Louisville Free Public Library, Grant County Public Library, Hardin County Public Library, and George Coon Public Library. Survey responses were reviewed for representativeness to ensure the reliability and validity of the findings.
Intent: Improve library operations.

Activity: Planning & Evaluation
Mode: Retrospective
Format: Third party

Quantity
Number of evaluations and/or plans funded: 1
Number of funded evaluation and/or plans completed: 1

Partner Information

Organization Type of Partner Organization(s):
Libraries: Yes
Historical Societies or Organizations: No
Museums: No
Archives: No
Cultural Heritage Organization Multi-type: No
Preschools: No
Schools: No
Adult Education: No
Human Service Organizations: No
Other: No

Legal Type of Partner Organization(s):
Federal Government: No
State Government: No
Local Government (excluding school districts): No
School District: No
Non-Profit: No
Private Sector: No
Tribe/Native Hawaiian Organization: No

Beneficiaries
Is the activity directed at the library workforce: No
For a targeted group or for the general population: General

Locale
Is the activity state-wide: Yes
Specific Locations: No
Library Types

Public Libraries: 0
Academic Libraries: 0
SLAA: 1
Consortia: 0
Special Libraries: 0
School Libraries: 0
Other: 0

Activity Details
Title: Five-Year Plan - Planning-Prospective
Narrative: The State Plan sets forth the activities to be taken toward meeting the identified needs supported with the assistance of Federal funds made available under the Library Services and Technology Act (LSTA). KDLA contracted with QualityMetrics LLC (QM) to enlist their aid in composing its Grants to States 2018-2022 LSTA Five-Year Plan. The process included determining projects and subsequent actions through which the intent of the projects will be accomplished. After completing a needs assessment, QM obtained KDLA-identified goals that aligned with purposes and priorities of LSTA. KDLA identified new priorities that will allow the library and its stakeholders to adapt effectively to a changing library environment, developed a coordinated plan to benefit stakeholders, and created results-based outputs and outcomes
Intent: Improve library operations.

Activity: Planning & Evaluation
Mode: Prospective
Format: Third party

Quantity
Number of evaluations and/or plans funded: 1
Number of funded evaluation and/or plans completed: 1

Partner Information

Public Libraries: 0
Academic Libraries: 0
SLAA: 1
Consortia: 0
Special Libraries: 0
School Libraries: 0
Other: 0

Project Outcomes
Project Outcomes
List any important outcomes or findings not previously reported:
QualityMetrics concluded that KDLA’s 2013-2017 Five-Year Plan Evaluation would only represents public libraries as the majority of responses to the web survey were from public libraries. Two hundred eighty-seven individuals responded to the 2013-2017 LSTA evaluation web survey. Ninety-eight (98.2) percent were public libraries. Twenty-five (25.6) percent of the respondents were library directors. Another fifteen (15.4) percent were a manager or department head. Thirty-nine (39.1) percent of the respondents indicated their library served a population of 10,000 to 24,000. Fifteen (15.1) percent were in libraries serving populations of 100,000 or more and two respondents served a population of 500 to 1,999. The largest group, (36.6) percent, had five to nine full-time equivalent (FTE) staff. Another sixteen (16.8) percent were in libraries with ten to nineteen FTE. Two (representing 0.7 percent of total respondents) reported an FTE of less than two; one reported an FTE of 1,000 or more. Because half of the respondents’ libraries were represented by less than ten FTE, KDLA’s Evaluation and Plan activities only embody public libraries from the perspective of two staff size groupings. Those libraries with less than ten FTE were labeled ‘small’ libraries and libraries with more than ten FTEs, ‘large’ libraries. QualityMetrics (QM) analyzed the data, which included a self-assessment by KDLA, and in their estimation, KDLA has, “using the measure of leveraging a small amount of money to accomplish major results by strategically deploying LSTA funds, achieved some notable results by carrying out the goals included in its five-year LSTA Plan for 2013-2017.” QualityMetrics concluded that KDLA successfully achieved two out of its three LSTA Grants to States Program goals, noting that the one goal was partially achieved. Goal 1 - Expand Access to Information: Discovery, Delivery, and Innovation and Goal 2 - Build Foundations for Sustainable Growth and Strength in Kentucky Libraries were met. Goal 3 Strengthen Support for Targeted Library Programs and Services was partly achieved. QM concurred with KDLA’s self-observation that the evaluation targets did not effectively correspond with the activities of Goal 3 and that therefore, the implementation of new programs and services established in public libraries as a direct result of public library standards and continuing education from KDLA were not realized.
Please briefly describe the importance of these outcomes and findings for future program planning:
QualityMetrics (QM) characterized KDLA’s implementation of the LSTA Program as supportive and referred to deployment as a hybrid approach to the use of its Grants to States LSTA allotment. QM determined that “nearly everything that has been accomplished by KDLA can be described as being supportive of the work of local libraries and ensuring the availability of quality basic library and information services to State employees and to the residents of the state.” This approach will be followed into the next five years with the new goals selected by KDLA staff. Activities supported through future LSTA Grants to States funding in Kentucky will meet the information needs of Kentucky citizens of all ages and abilities. Goal 1 - provide access to resources and public records, Goal 2 - improve the capacity of libraries and archives through staff development and training opportunities, and Goal 3 - aid libraries in improving services to Kentucky residents including services that support lifelong learning, employment, early literacy and youth development, and civic engagement. By strategically deploying LSTA funds, supplemented by local, state, private and charitable giving, other foundations and grant sources as appropriate, KDLA will continue to "leverage a small amount of money to accomplish significant results (QM)".
Explain one or two of the most significant lessons learned for others wanting to adopt any facets of this project:

Do you anticipate continuing this project after the current reporting period ends:
No
Do you anticipate any change in level of effort in managing this project:
No
Explain:

Do you anticipate changing the types of activities and objectives addressed by the project:
No
Explain:

Was an evaluation conducted for this project:
Yes
Was a final written evaluation report produced:
Yes
Can the final written evaluation report be shared publicly on the IMLS website:
Yes
Was the evaluation conducted by project staff (either SLAA or local library) or by a third-party evaluator:
Third-Party
What data collection tools were used for any report outcomes and outputs:
Administrative Records
Review Surveys
Focus Groups
Did you collect any media for the data:
What types of methods were used to analyze collected data:
Statistical Methods
Qualitative Methods
Other:
How were participants (or items) selected:
Other: KDLA stakeholders
What type of research design did you use to compare the value for any reported output or outcome:
No comparison for any reported output or outcome:

Exemplary: No
Exemplary Narrative

Project Tags: planning, evaluation