Qualitative insight into the industry’s top vendors through 18 key performance indicators
Black Book utilizes a three-step process to collect candid performance data.
Black Book collects a series of direct evaluations covering 31 performance areas on leadership and senior management which comprise the scored ranking of the “Black Book 50 Best Managed Vendors”. These scores are isolated and used in a like comparison of all outsourcing vendors of all domains.
Black Book collects ballot results on 18 performance areas of operational excellence to rank vendors by outsourced service lines. Client users submit ballots per vendor per function which are juxtaposed with client size, functions outsourced, industry/vertical(s) affected, country of service origin and overall outsourcing domain.
The gathered data is subjected immediately to an internal and external audit to verify completeness and accuracy and to make sure the respondent is valid while ensuring the anonymity of the client company is maintained. During the audit, each data set is reviewed by a Brown-Wilson executive and at least two other external reviewers. In this way, Black Book report clients are able to clearly see how a vendor is truly performing. The 18 criteria on operational excellence are subdivided by the client’s industry, market size, geography and function outsourced and reported accordingly.
Understanding the Statistical Confidence of Black Book Data
- Top-10-ranked vendors and advisors must have a minimum of five unique clients represented. Broad categories require a minimum of 10 unique client ballots. Data that are asterisked (*) represent a sample size below required limits and are intended to be used for tracking purposes only, not ranking purposes. Performance data for an asterisked vendor’s services can vary widely until a larger sample size is achieved. The margin of error can be very large and the reader is responsible for considering the possible current and future variation (margin of error) in the Black Book performance score reported.
- Vendors and advisors with over 10 unique client votes are eligible for top 10 rankings and are assured to have highest confidence and lowest variation. Confidence increases as more organizations report on their outsourcing vendor. Data reported in this form are shown with a 95% confidence level (within a margin of 0.25, 0.20 or 0.15, respectively).
- Raw numbers include the quantity of completed surveys and the number of unique organizations contributing the data for the survey pool of interest.
Vendor achieves the overall preference for expertise, appreciation and insight within the client’s respective vertical. Organizational structure meets or exceeds the needs of stakeholders and customers in this industry. The client is overwhelmingly likely to recommend the vendor for an outsourcing engagement for the same vertical outsourcing initiatives.
Trust in enterprise reputation is crucial to the outsourced services client as well as prospects. Client possesses an understanding that their outsourcing organization has the people, processes and resources to effectively deliver the desired business results, based on its industry reputation and past performance.
Vendor meets agreed terms as evidenced by routine, acceptable service level reporting and industry expectations. Depth and breadth of applications/solutions are acceptable in meeting client needs. Online reliability is maximized and outages/downtimes are minimized. Solid product and outsourcing service capacities are demonstrated consistently. Service levels are consistently met as agreed. Services and support response is maximized by vendor team
Vendor’s viability, employee turnover, financial stability and/or cultural mismatches do not threaten relationship. This outsourcing vendor takes extraordinary efforts to avoid relationship problems among service providers and the client as well. Senior management and board exemplify strong leadership principals to steward resources appropriate that impact buyers.
In order to provide a secure and constantly dependable service offering for product development entities, an outsourcing vendor has to provide the highest level of security and data back-up services. In some cases, you may find their service in these two areas superior to the security and back-up system in your own firm/corporation.
Outsourcing leadership provides an adequate amount of onsite administration and support to clients. There exists a formal outsourcing relationship and account management program that meets client needs among suppliers for the customer. Vendor evidences successful management strategies or services. Media and clients reference this vendor as a service leader and top producer correctly based on evidenced support programming. Customer services and relationship satisfaction is manifested through significant flagship clients as well as smaller and newest customers similarly. Customer satisfaction is manifested as a vendor priority without compromise.
Related technology services and product management are considered best in breed. Vendor technology elevates customers via capabilities, equipment, processes, deliverables, professional staff, leadership, quality assurance and innovative initiatives. Technology services are delivered at or above current/former in-house service levels. Quality assurance and process improvement is integrated into all initiatives. Vendor leadership drives continuous services improvements to point of client service