How our test assesses Python skills
In Picked's Python test, candidates will need to answer a range of questions targeting an intermediate level of proficiency in the programming language. This includes building tools in Python, testing and debugging Python code, as well as more challenging questions around maintaining scalable Python code.
The test is designed to indicate how well a candidate understands Python based on a final test score, which can then be compared to the scores of other applicants.
The multiple-choice questions consist of one correct answer and two to four distractors. The distractors are mostly generic mistakes or misconceptions, which makes the test challenging and helps measure a candidate's proficiency more accurately.
During the development process, the test was rigorously analysed to maximise reliability and validity in line with industry best practices. It was created and reviewed by programmers and psychometric experts, and field-tested with a representative sample of job applicants who have varying Python experience, just like you might find in a talent pool.
Each test is reviewed by a panel of individuals representing diverse backgrounds to check for any sensitivity, fairness, face validity and accessibility issues. This ensures each programmer has a fair chance of demonstrating their true level of Python proficiency and feels the test is high quality.
Our programming tests are monitored to ensure they are up-to-date and optimised for performance.