Running dashboard reports
After you log into RAPID, select Report Server. All available dashboard reports will be found here. There are four end-user dashboards. Dashboards have the same basic organization with drop down menus at the top that allow different options for the dashboard. After you have selected the desired options, click View Report on the top right for the dashboard to load. Feel free to experiment—these dashboards do not write data and you can’t break anything.
Events Affecting SRTR
This dashboard demonstrates the cohorts that comprise each SRTR PSR through all available data. The PSR release dates are each row (y axis), and the calendar dates are across the top (x axis), with current date at the far right.
With each new cohort, the earliest six months of the previous cohort drops off (light green) and a new six months is added (dark red).
When an event occurs (graft failure or patient death), a bright red vertical line indicates which PSR cohorts will be affected by the event.
The observed and expected raw survival percentages for each six-month cohort can be seen at the top below the dates.
The cohort size, observed, and expected survival percentages for each PSR is available.
All data after the latest published PSR is speculative, that is to say it is based on the data you have submitted to UNOS. If you have not reported a graft failure or patient expiration to UNOS, it will not be available on the dashboard.
Projected Transplant PSR Dashboard
This dashboard demonstrates future PSR performance in the critical O-E, O/E, and one-sided p value based on the data you have submitted to UNOS. The dashboard utilizes the beta coefficients from the most recently published PSR to calculate the expected. (How do you calculate the risk adjustment?)
When the number of observed events is small, O/E would trigger first, followed by O-E. If the number of observed events is large, then O-E is would trigger first. One-sided p value would trigger last in any event, likely resulting in a CMS audit.
The Report Begin Date defaults to the latest published PSR.
There are four graphs, organized in 2 x 2 fashion as follows.
O-E patient survival
O/E patient survival
O-E graft survival
O/E graft survival
The plots have the following general features.
- The y axis indicates O-E or O/E, and the regulatory threshold is marked by a bright red horizontal line (3 for O-E and 1.5 for O/E, please refer to SRTR documentation for further details).
- The x axis are the PSR release dates every six months through all available data.
- The projected O-E and O/E are indicated by blue dots. All completed cohorts are connected by a blue dashed line. Incomplete cohorts are represented by a just a blue dot.
- The green dot indicates the published SRTR value. (Why doesn’t the green dot match the blue dot?!)
- You can choose to use only UNOS data to calculate the projected PSR statistics, or use SRTR data (when available) with the UNOS data. (What is the difference between using UNOS and SRTR data in projected PSR reports?)
- Optionally, parametric and non-parametric, bias-corrected and accelerated bootstrap confidence intervals are available. As the confidence intervals can be very large, you may wish to disable them to get a better view of your metrics because the y axis auto-scales. (Why are the confidence intervals so large?)
- For those who prefer to follow the raw survival percentages, they are found at the top of each plot.
- If you hover over the blue point estimate, a pop-up window will appear.
- The actual point estimate O-E or O/E
- The one-sided p value. Double it to get the two-sided p value.
- For incomplete cohorts in O-E plots,
- The critical value, the total number of events before you exceed the one-sided p value.
- The number of additional observed events before you exceed the one-sided p value.
- Time before cohort closes
The cohorts will become more and more sparse the further out you go. It is possible that the most report farthest in the future has no events or transplants.
Tabular Projected PSR Dashboard
This dashboard report provides largely the same information as the graphical Projected Transplant PSR Dashboard in tabular form, but also includes preliminary support for the proposed Bayesian flagging criteria.
The dashboard report gives the kidney and liver transplant volumes over the last 2.5 years in six-month cohorts. A simple projection for the current six months is found in gray.
These are “back-end” reports that give you access to the underlying data used to make the calculations for the dashboards. You can use them to spot any discrepancies between UNOS and SRTR data.