Ohio's Families and Children Rule Review Site

5101:2-33-02 PCSA requirement to participate in child protection oversight and evaluation.

This rule is no longer open for comment. However, here you can view an archived, read-only version of the rule and any associated comments.

Please be advised the following Ohio Administrative Code Rule has been requested for a five year rule review and will be posted to 30 days.

(A) The public children services agency (PCSA) shall participate with the Ohio department of job and family services (ODJFS) staff in the child protection oversight and evaluation (CPOE) quality improvement review no less than once every twenty-four months.

(B) The PCSA shall make available relevant documents and personnel during the CPOE quality improvement review process.

(C) The CPOE review of the PCSA shall include, but not be limited to, the examination and analysis of the following in relation to the PCSA's delivery of child welfare services to children and families:

(1) Outcome indicators involving child safety, child permanency, and child and family well-being.

(2) Compliance with statutorily mandated PCSA responsibilities.

(3) Selected child welfare program components across the continuum.

(D) The CPOE review shall include discussion and inquiry as to the systemic factors that contribute to the PCSA's delivery of child welfare services including, but not limited to, the following:

(1) Local demographic data.

(2) Information regarding the PCSA's infrastructure including the table of organization.

(3) Staffing levels.

(4) Caseload sizes.

(5) PCSA budgetary data.

(6) The availability of supportive services in the community.

(7) Exemplary casework practices.

(E) Information sources that can be utilized during the evaluation, reconciliation of case data report measures, and the quality improvement review process include, but are not limited to, the following:

(1) Data reports generated from the ODJFS management information systems containing PCSA data including, but not limited to, the statewide automated child welfare information system, results oriented management and business intelligence channel.

(2) Findings obtained from client, shareholder, provider, and PCSA staff interviews, as applicable.

(3) Information obtained from the review of the PCSA's case records whether hard copy file, electronic file, or a combination of both.

(4) Data obtained from the PCSA's data management systems, as applicable.

(5) Other information concerning the PCSA's service delivery system including, but not limited to, council on accreditation findings, strategic planning data, and county budgetary data.

(F) If the PCSA is writing a response to either clarify its position or address the conclusions regarding the evaluation and assessment of the PCSA's programmatic performance in the delivery of child welfare services within the CPOE report without seeking to change the CPOE report or its findings, the PCSA shall submit an addendum within fifteen days of the PCSA's receipt of the CPOE final report to ODJFS. . The PCSA's addendum shall be attached to the CPOE report and maintained in the CPOE record.

(G) If the PCSA is writing a response to dispute one or more of the CPOE report findings and is requesting a decision by ODJFS to change the CPOE report or its findings, the PCSA shall submit an appeal of the CPOE final report to ODJFS within fifteen days of the PCSA's receipt of the CPOE final report . The appeal decision by ODJFS shall be final.

(H) If the PCSA fails to meet one or more of the established outcome indicators listed in paragraph (C) of this rule, the PCSA shall develop and submit for acceptance by ODJFS a quality improvement plan (QIP) within thirty days from the PCSA's receipt of the CPOE final report or within thirty days from the PCSA's receipt of the CPOE appeal decision.

(I) The QIP shall include the activities the PCSA will conduct to address identified deficiencies in the PCSA's programmatic performance in the delivery of child welfare services, as outlined in the CPOE final report, in order to bring the agency into compliance. The PCSA may request ODJFS assist the PCSA with the development of the QIP and provide the PCSA technical assistance in the implementation of the plan pursuant to section 5101.221 of the Revised Code.

(J) If the PCSA requests an extension of the time frame for submittal of the QIP, all of the following shall occur:

(1) The request to extend the time frame will be made in writing and submitted to ODJFS prior to the expiration of the established time frame for submittal of the QIP as outlined in paragraph (H) of this rule.

(2) The request will contain the rationale as to the basis for the extension.

(3) The decision to grant the extension will be provided within fifteen days of the receipt of the request.

(4) The length of the extension will be based on the rationale provided for the basis of the extension.

(K) Upon acceptance of the QIP, the PCSA shall implement the QIP in order to achieve the identified outcomes.

(L) The PCSA shall participate in monitoring the implementation of the QIP and achievement of the identified goals.

(M) The QIP shall remain in effect until the outcomes are achieved or a subsequent QIP is developed in accordance with paragraph (H) of this rule.

(N) PCSA achievement of specific measures or changes addressing concerns identified through the CPOE process may result in incentives to PCSAs.

(O) PCSA failure to develop, implement, or monitor a QIP may result in action against the PCSA in accordance with section 5101.24 of the Revised Code.

Effective: 3/1/2015
Five Year Review (FYR) Dates: 11/26/2014 and 03/01/2020
Promulgated Under: 119.03
Statutory Authority: 5101.141, 5103.03, 5153.166
Rule Amplifies: 5101.22, 5101.221, 5103.03, 5153.16
Prior Effective Dates: 7/1/97, 2/1/03, 1/1/05, 3/01/10

3I Approve
11I Agree3I Disagree
quality improvement plan (QIP)
Susan Halter
03-09-2020 (8:54am)
Does this need changed to Plan for Practice Advancement (PIP)
Show related text
In regards to: quality improvement plan (QIP)
9I Agree2I Disagree
The QIP shall include
Susan Halter
03-09-2020 (8:56am)
QIP appears 11 times within the document. Does QIP need to reflect the previous suggested change? QIP should be PPA.
Show related text
In regards to: The QIP shall include
7I Agree2I Disagree
(H) If the PCSA fails to meet one or more of the established outcome indica...
Susan Halter
03-09-2020 (9:01am)
For CPOE 12, the described process has been changed. The PCSA will conduct a Self-Assessment and then develop a PPA. There is a review of cases throughout the PPA process. Do these sections need updated to reflect the current CPOE process?
Show related text
In regards to: (H) If the PCSA fails to meet one or more of the established outcome indicators listed in paragraph (C) of this rule, the PCSA shall develop and submit for acceptance by ODJFS a quality improvement plan (QIP) within thirty days from the PCSA's receipt of the CPOE final report or within thirty days from the PCSA's receipt of the CPOE appeal decision. (I) The QIP shall include the activities the PCSA will conduct to address identified deficiencies in the PCSA's programmatic performance in the delivery of child welfare services, as outlined in the CPOE final report, in order to bring the agency into compliance. The PCSA may request ODJFS assist the PCSA with the development of the QIP and provide the PCSA technical assistance in the implementation of the plan pursuant to section 5101.221 of the Revised Code.
51I Agree1I Disagree
(3) Selected child welfare program components across the continuum.
Richard Tvaroch
03-26-2020 (3:19pm)
This section either needs to be operationally defined or removed.
Show related text
In regards to: (3) Selected child welfare program components across the continuum.
47I Agree1I Disagree
(D) The CPOE review shall include discussion and inquiry as to the systemic...
Richard Tvaroch
03-27-2020 (2:56pm)
Re-letter and insert the following as the new paragraph D: (D) The CPOE review of the PCSA shall not include an examination and analysis of the following: (1) Report screening classification and decisions. (2) Report dispositions. (3) Child placement decisions.
Show related text
In regards to: (D) The CPOE review shall include discussion and inquiry as to the systemic factors that contribute to the PCSA's delivery of child welfare services including, but not limited to, the following:
45I Agree1I Disagree
(3) Information obtained from the review of the PCSA's case records whether...
Richard Tvaroch
03-27-2020 (3:02pm)
Trumbull County Children Services recommends that the following be added as (E) (3) (a): a. If the CPOE Review process includes a review of the PCSA's case records, a statically valid sampling technique with a minimum 95% Confidence Level and a 10% Confidence Interval shall be used.
Show related text
In regards to: (3) Information obtained from the review of the PCSA's case records whether hard copy file, electronic file, or a combination of both.
41I Agree1I Disagree
(G) If the PCSA is writing a response to dispute one or more of the CPOE re...
Richard Tvaroch
03-27-2020 (3:08pm)
Trumbull County Children Services recommends that the following be add as (G) (1)..(3): (1) Any/all written responses and/or appeals submitted by the PCSA shall be attached as an addendum to CPOE final report. (2) The ODJFS appeal officer shall be outside the assigned Technical Assistance Specialists’ chain of supervision. (3) The CPOE report findings will be corrected if the appeal process reveals that it contained factual inaccuracies or inaccurate interpretation/ application of rule
Show related text
In regards to: (G) If the PCSA is writing a response to dispute one or more of the CPOE report findings and is requesting a decision by ODJFS to change the CPOE report or its findings, the PCSA shall submit an appeal of the CPOE final report to ODJFS within fifteen days of the PCSA's receipt of the CPOE final report . The appeal decision by ODJFS shall be final
40I Agree1I Disagree
(H) If the PCSA fails to meet one or more of the established outcome indica...
Richard Tvaroch
03-27-2020 (3:14pm)
Trumbull County Children Services recommends that the following be added as (H)(1): (1) ODJFS shall assist the PCSA conduct a root cause analysis of any identified deficiencies in programmatic performance if requested.
Show related text
In regards to: (H) If the PCSA fails to meet one or more of the established outcome indicators listed in paragraph (C) of this rule, the PCSA shall develop and submit for acceptance by ODJFS a quality improvement plan (QIP) within thirty days from the PCSA's receipt of the CPOE final report or within thirty days from the PCSA's receipt of the CPOE appeal decision
42I Agree1I Disagree
(J) If the PCSA requests an extension of the time frame for submittal of th...
Richard Tvaroch
03-27-2020 (3:20pm)
Trumbull County Children Services recommends that the following be added as (J) (5) and (J) (5) (a): (5) If the request for an extension of the time frame for submittal of the QIP is denied, the PCSA shall be provided with a written rationale. a. The written rationale for a denial for an extension of the time frame for submittal of the QIP shall be included as an addendum to CPOE report findings.
Show related text
In regards to: (J) If the PCSA requests an extension of the time frame for submittal of the QIP, all of the following shall occur: (1) The request to extend the time frame will be made in writing and submitted to ODJFS prior to the expiration of the established time frame for submittal of the QIP as outlined in paragraph (H) of this rule. (2) The request will contain the rationale as to the basis for the extension. (3) The decision to grant the extension will be provided within fifteen days of the receipt of the request. (4) The length of the extension will be based on the rationale provided for the basis of the extension
21I Agree1I Disagree
(F) If the PCSA is writing a response to either clarify its position or add...
Richard Tvaroch
03-30-2020 (10:09am)
Trumbull County Children Services recommends that that following be added as (F)(1) and (F)(1)(a): (F) (1) If the PCSA’s written response exposes a factual inaccuracy in the CPOE Report or its findings, the CPOE Report shall be retracted, corrected, and reissued by ODJFS. (F)(1)(a) The appeal timeframes outlined in paragraph G of this rule shall begin on the date that the PCSA receives the reissued CPOE Report.
Show related text
In regards to: (F) If the PCSA is writing a response to either clarify its position or address the conclusions regarding the evaluation and assessment of the PCSA's programmatic performance in the delivery of child welfare services within the CPOE report without seeking to change the CPOE report or its findings, the PCSA shall submit an addendum within fifteen days of the PCSA's receipt of the CPOE final report to ODJFS. . The PCSA's addendum shall be attached to the CPOE report and maintained in the CPOE record.
9I Agree0I Disagree
3) Selected child welfare program components across the continuum.
Shelby Cully
03-31-2020 (11:55am)
This phrase is ambiguous. We would request this section be reworded to give agencies clarity as to what may be subject to examination and analysis during a CPOE review.
Show related text
In regards to: 3) Selected child welfare program components across the continuum.
5I Agree0I Disagree
C) The CPOE review of the PCSA shall include, but not be limited to, the ex...
Shelby Cully
03-31-2020 (12:31pm)
As drafted, the language states that the CPOE review shall include, ”but not be limited to“ and list 3 areas. By including the language“but not limited to“, the rule allows the State to review areas of practice that have no rule or law directing practice, such as screening decisions. The review of these discretionary practices in a public document is worrisome, not because agencies do not want to be reviewed and assisted with practice improvements but because the reviews could not be applied uniformly across the State as there are not uniform rules that counties are able to follow. Instead of including reviews of discretionary practices in CPOE we would suggest language in the rule that would keep CPOE reviews strictly about rule/law compliance.
Show related text
In regards to: C) The CPOE review of the PCSA shall include, but not be limited to, the examination and analysis of the following in relation to the PCSA's delivery of child welfare services to children and families: (1) Outcome indicators involving child safety, child permanency, and child and family well-being. (2) Compliance with statutorily mandated PCSA responsibilities.
7I Agree0I Disagree
G) If the PCSA is writing a response to dispute one or more of the CPOE rep...
Shelby Cully
03-31-2020 (12:46pm)
To ensure the Appeal process is meaningful and transparent it would be helpful to have the process set out in the rule. For example, what standard of review will be used to determine if a finding should be overturned? It would also be helpful to know who completes the appeals, is the person outside of the TAS’s chain of command and therefore a neutral reviewer? Is there a time frame for an appeal decision so an agency knows when to expect an outcome? Even if an appeal is not overturned, is there a mechanism to allow for certain corrections to the original finding that may have been done in error? Finally, as there is a mechanism for an agency to attach an addendum if they do not appeal, could this also be included as an option if an appeal is requested by not overturned?
Show related text
In regards to: G) If the PCSA is writing a response to dispute one or more of the CPOE report findings and is requesting a decision by ODJFS to change the CPOE report or its findings, the PCSA shall submit an appeal of the CPOE final report to ODJFS within fifteen days of the PCSA's receipt of the CPOE final report . The appeal decision by ODJFS shall be final
6I Agree0I Disagree
(C) The CPOE review of the PCSA shall include, but not be limited to, the e...
Tim Schaffner
04-02-2020 (5:06pm)
Trumbull County Children Services is very concerned and disagree with the inclusion of screening decisions as part of CPOE 12. We agree that screening is a practice area that can be examined and improved; however, we believe this must be done outside of the CPOE 12 review process. Because CPOE reports are public documents, it is not appropriate to include items in this process that are not spelled out in ORC or OAC but rather leave the review solely to the discretion and judgment of the reviewers. Instead, work on screening could occur parallel to the CPOE review process and also include the advisory group mentioned below. This work could then inform the screening guidelines which have been under review and revision for the past several years. We have similar concerns regarding the possibility that screening classifications, report dispositions, and child placement decisions could be added to future CPOE iterations. These decisions are all the interruptive application of local legal expectations cultivated over time. They are more art than science. This would make it impossible for a TAS to fairly and objectively review these decisions. Therefore, we suggest adding the following as new sections (D) and (D) (1) … (D)(3): (D) The CPOE review of the PCSA shall not include an examination and analysis of the following: (D) (1) Report screening classification and decisions. (D) (2) Report dispositions. (D) (3) Child placement decisions.
Show related text
In regards to: (C) The CPOE review of the PCSA shall include, but not be limited to, the examination and analysis of the following in relation to the PCSA's delivery of child welfare services to children and families: (1) Outcome indicators involving child safety, child permanency, and child and family well-being. (2) Compliance with statutorily mandated PCSA responsibilities. (3) Selected child welfare program components across the continuum. (D) The CPOE review shall include discussion and inquiry as to the systemic factors that contribute to the PCSA's delivery of child welfare services including, but not limited to, the following:
5I Agree0I Disagree
(E) Information sources that can be utilized during the evaluation, reconci...
Tim Schaffner
04-02-2020 (5:08pm)
Trumbull County Children Services believes that this rule entering the clearance process provides an opportune time to shift the CPOE review towards a more data-driven approach and less reliant on case reviews. Over time, data reports through SACWIS, ROM, and BIC have become more available and are a largely untapped resource for CQI initiatives at the local level. In addition, the current case review component for most counties is not of sufficient size to be statistically valid, raising concerns about the value of case reviews in this manner. We suggest focusing the CPOE review on one or two key issues that can “move the needle”, such as quality of home visits, and review a wider range of cases on those limited issues. In other words, develop a review that is limited in scope but broad in the number of cases reviewed for those issues. To this end, we suggest adding the following as a new section (E) (3) (a): If the CPOE review process includes a review of the PCSA’s case records, a statistically valid sampling technique with a minimum 95% Confidence Level and a 10% Confidence Interval shall be used.
Show related text
In regards to: (E) Information sources that can be utilized during the evaluation, reconciliation of case data report measures, and the quality improvement review process include, but are not limited to, the following: (1) Data reports generated from the ODJFS management information systems containing PCSA data including, but not limited to, the statewide automated child welfare information system, results oriented management and business intelligence channel. (2) Findings obtained from client, shareholder, provider, and PCSA staff interviews, as applicable. (3) Information obtained from the review of the PCSA's case records whether hard copy file, electronic file, or a combination of both.
4I Agree0I Disagree
(F) If the PCSA is writing a response to either clarify its position or add...
Tim Schaffner
04-02-2020 (5:09pm)
Trumbull County Children Services feels that changes need to be made to this rule to strengthen the appeal process to ensure the report provides a full and accurate picture of the review and to ensure appropriate QIP timeframes are applied. To this end, we suggest adding the following as a new section: (F) (1) If the PCSA’s written response notes a factual inaccuracy in the CPOE Report or its findings, the CPOE Report shall be retracted, corrected, and reissued by ODFJS. (F) (1) (a) The appeal timeframes outlined in paragraph G of this rule shall begin on the date that the PCSA receives the reissued CPOE Report. (G) (1) Any/all written responses and/or appeals submitted by the PCSA shall be attached as an addendum to the CPOE final report. (G) (2) The ODJFS appeal officer shall be outside the assigned Technical Assistance Specialists’ chain of supervision. (G) (3) The CPOE Report findings will be corrected if the appeal process reveals that it contained factual inaccuracies or inaccurate interpretation/application of rule. (J) (5) If the request for an extension of the time frame for submittal of the QIP is denied, ODJFS shall provide the PCSA with a written rationale. (J) (5) (a) The written rationale for a denial for an extension of the time frame for submittal of the QIP shall be included as an addendum to CPOE report findings.
Show related text
In regards to: (F) If the PCSA is writing a response to either clarify its position or address the conclusions regarding the evaluation and assessment of the PCSA's programmatic performance in the delivery of child welfare services within the CPOE report without seeking to change the CPOE report or its findings, the PCSA shall submit an addendum within fifteen days of the PCSA's receipt of the CPOE final report to ODJFS. . The PCSA's addendum shall be attached to the CPOE report and maintained in the CPOE record. (G) If the PCSA is writing a response to dispute one or more of the CPOE report findings and is requesting a decision by ODJFS to change the CPOE report or its findings, the PCSA shall submit an appeal of the CPOE final report to ODJFS within fifteen days of the PCSA's receipt of the CPOE final report . The appeal decision by ODJFS shall be final.
5I Agree0I Disagree
(C) The CPOE review of the PCSA shall include, but not be limited to, the e...
Marilyn Pape
04-03-2020 (9:02am)
Trumbull County Children Services is very concerned and disagrees with the inclusion of screening decisions as part of CPOE 12. We also have similar concerns regarding the possibility that screening classifications, report dispositions, and child placement decisions could be added to future CPOE iterations. These decisions are the interruptive application of local legal expectations and experiences cultivated over time. They are more art than science. This makes it impossible for a TAS to fairly and objectively review these decisions. Therefore, we suggest adding the following as new sections (D) and (D) (1) … (D)(3): (D) The CPOE review of the PCSA shall not include an examination and analysis of the following: (D) (1) Report screening classification and decisions. (D) (2) Report dispositions. (D) (3) Child placement decisions.
Show related text
In regards to: (C) The CPOE review of the PCSA shall include, but not be limited to, the examination and analysis of the following in relation to the PCSA's delivery of child welfare services to children and families: (1) Outcome indicators involving child safety, child permanency, and child and family well-being. (2) Compliance with statutorily mandated PCSA responsibilities. (3) Selected child welfare program components across the continuum. (D) The CPOE review shall include discussion and inquiry as to the systemic factors that contribute to the PCSA's delivery of child welfare services including, but not limited to, the following:
7I Agree0I Disagree
(C) The CPOE review of the PCSA shall include, but not be limited to, the e...
Renee Bastounis
04-03-2020 (10:03am)
Trumbull County Children Services is very concerned and disagrees with the inclusion of screening decisions as part of CPOE 12. Because the heart of the screening rule, 5101:2-36-01 (F), simply refers to Ohio Revised Code, how are the Department’s Technical Assistance Specialists qualified to assess the “correctness” of a screening decision? They are not attorneys. When the Department has always resisted giving the counties legal guidance, why does it now want to be involved in shaping our screening practices, which are, at their foundation, the interpretation and application of ORC? We also have similar concerns regarding the possibility that screening classifications, report dispositions, and child placement decisions could be added to future CPOE iterations. These decisions are all more art than science. This makes it impossible for a TAS to fairly and objectively review them. Therefore, we suggest adding the following as new sections (D) and (D) (1) … (D)(3): (D) The CPOE review of the PCSA shall not include an examination and analysis of the following: (D) (1) Report screening classification and decisions. (D) (2) Report dispositions. (D) (3) Child placement decisions.
Show related text
In regards to: (C) The CPOE review of the PCSA shall include, but not be limited to, the examination and analysis of the following in relation to the PCSA's delivery of child welfare services to children and families: (1) Outcome indicators involving child safety, child permanency, and child and family well-being. (2) Compliance with statutorily mandated PCSA responsibilities. (3) Selected child welfare program components across the continuum. (D) The CPOE review shall include discussion and inquiry as to the systemic factors that contribute to the PCSA's delivery of child welfare services including, but not limited to, the following
20I Agree0I Disagree
A) The public children services agency (PCSA) shall participate with the Oh...
Mary Wachtel
04-03-2020 (12:05pm)
PCSAO and its member agencies are very concerned and disagree with the inclusion of screening decisions as part of CPOE 12. We agree that screening is a practice area that can be examined and improved; however, we believe this must be done outside of the CPOE 12 review process. Because CPOE reports are public documents, it is not appropriate to include items in this process that are not spelled out in ORC or OAC but rather leave the review solely to the discretion and judgment of the reviewers. Instead, work on screening could occur parallel to the CPOE review process and also include the advisory group mentioned below. This work could then inform the screening guidelines which have been under review and revision for the past several years.
Show related text
In regards to: A) The public children services agency (PCSA) shall participate with the Ohio department of job and family services (ODJFS) staff in the child protection oversight and evaluation (CPOE) quality improvement review no less than once every twenty-four months.
20I Agree0I Disagree
The public children services agency (PCSA) shall participate with the Ohio ...
Mary Wachtel
04-03-2020 (12:08pm)
We appreciate the spirit of the changes ODJFS has made to CPOE 12 and the goal to provide child welfare agencies the opportunity to improve performance prior to a more extensive casework evaluation. We appreciate the emphasis on collaboration between ODJFS and PCSAs and Title IV-E Courts to identify areas for performance improvement and cooperatively develop a Plan for Practice Advancement (PPA) which will then be implemented and evaluated over the course of the CPOE review. However, we believe CPOE 12 to be a “next step” and sincerely hope the work will not stop there. As we move through the CPOE 12 process, we encourage ODJFS to form an advisory group made up of representative PCSAs and IV-E Courts to further redesign the CPOE process to a robust quality improvement tool that significantly advances children services practice.
Show related text
In regards to: The public children services agency (PCSA) shall participate with the Ohio department of job and family services (ODJFS) staff in the child protection oversight and evaluation (CPOE) quality improvement review no less than once every twenty-four months.
20I Agree0I Disagree
nformation sources that can be utilized during the evaluation, reconciliati...
Mary Wachtel
04-03-2020 (12:09pm)
Overall, we believe this is an opportune time to shift the CPOE review towards a more data-driven approach and less reliant on case reviews. Over time, data reports through SACWIS, ROM, and BIC have become more available and are a largely untapped resource for CQI initiatives at the local level. In addition, the current case review component for most counties is not of sufficient size to be statistically valid, raising concerns about the value of case reviews in this manner. We suggest focusing the CPOE review on one or two key issues that can “move the needle”, such as quality of home visits, and review a wider range of cases on those limited issues. In other words, develop a review that is limited in scope but broad in the number of cases reviewed for those issues. The CPOE process should align with best practices for evaluation and research, including accounting for size and capacity of each county, i.e., not all counties have dedicated CQI staff.
Show related text
In regards to: nformation sources that can be utilized during the evaluation, reconciliation of case data report measures, and the quality improvement review process include, but are not limited to, the following:
22I Agree0I Disagree
F) If the PCSA is writing a response to either clarify its position or addr...
Mary Wachtel
04-03-2020 (12:09pm)
The current appeals process does not assure that information provided by the PCSAs is included in the final report. At the least, inaccuracies noted by PCSAs should be included so the public can better interpret the review findings.
Show related text
In regards to: F) If the PCSA is writing a response to either clarify its position or address the conclusions regarding the evaluation and assessment of the PCSA's programmatic performance in the delivery of child welfare services within the CPOE report without seeking to change the CPOE report or its findings, the PCSA shall submit an addendum within fifteen days of the PCSA's receipt of the CPOE final report to ODJFS. . The PCSA's addendum shall be attached to the CPOE report and maintained in the CPOE record.
2I Agree0I Disagree
(3) Information obtained from the review of the PCSA's case records whether...
Marilyn Pape
04-03-2020 (8:41pm)
With the CFSR, to ensure the validity of Ohio's review, HHS allowed ODJFS to utilize a statistically valid sample. It is why 164 cases were reviewed. Surely, to ensure the validity of the CPOE review process, the PCSAs must be given the same consideration. Therefore, Trumbull County Children Services recommends that the following be added as a new section (E) (3) (a): "If the CPOE review process includes a review of the PCSA's case records, a statistically valid sampling technique with a minimum 95% Confidence Level and a 10% Confidence Interval shall be used."
Show related text
In regards to: (3) Information obtained from the review of the PCSA's case records whether hard copy file, electronic file, or a combination of both.
2I Agree0I Disagree
D) The CPOE review shall include discussion and inquiry as to the systemic ...
Erica Sabados
04-03-2020 (8:49pm)
Request that rule reflect commitment to support agencies in conducting process analysis/root cause analysis.
Show related text
In regards to: D) The CPOE review shall include discussion and inquiry as to the systemic factors that contribute to the PCSA's delivery of child welfare services including, but not limited to, the following:
2I Agree0I Disagree
(1) Data reports generated from the ODJFS management information systems co...
Erica Sabados
04-03-2020 (8:54pm)
Data considered for the review must include a review of data over a period of time, not point-in-time, point-to-point comparison. Review of data only over the course of the PUR is quite possibly insufficient in most cases to draw any valid conclusions. Further, quality of the data and limitations of the available data must be discussed as part of any assessment made of those findings.
Show related text
In regards to: (1) Data reports generated from the ODJFS management information systems containing PCSA data including, but not limited to, the statewide automated child welfare information system, results oriented management and business intelligence channel.
2I Agree0I Disagree
(C) The CPOE review of the PCSA shall include, but not be limited to, the e...
Erica Sabados
04-03-2020 (9:04pm)
Request efforts to develop a review process that is scientifically sound, reflective of best practices in research and evaluation. Narrowing the scope of the review process may aid in this effort.
Show related text
In regards to: (C) The CPOE review of the PCSA shall include, but not be limited to, the examination and analysis of the following in relation to the PCSA's delivery of child welfare services to children and families: (1) Outcome indicators involving child safety, child permanency, and child and family well-being. (2) Compliance with statutorily mandated PCSA responsibilities. (3) Selected child welfare program components across the continuum.
2I Agree0I Disagree
H) If the PCSA fails to meet one or more of the established outcome indicat...
Erica Sabados
04-03-2020 (9:08pm)
When an agency has "failed" an item, consider that the next required step is a JFS-assisted root causes analysis to form the basis upon which the QIP/PPA is developed. Much like a family assessment forms the basis of the case plan.
Show related text
In regards to: H) If the PCSA fails to meet one or more of the established outcome indicators listed in paragraph (C) of this rule, the PCSA shall develop and submit for acceptance by ODJFS a quality improvement plan (QIP) within thirty days from the PCSA's receipt of the CPOE final report or within thirty days from the PCSA's receipt of the CPOE appeal decision.