Overview
The quality of search results is critical for the success of LexisNexis online products. To help ensure that the quality of search and our generative AI solutions keep improving, we continuously the results of both search queries and prompts entered into our generative AI products. We do this by sending the results of these tests to subject matter experts who rate the relevance of the results.
There are hundreds of these tests conducted each year. To help manage and administer these tests, LexisNexis requires a Test Analyst.
The Test Analyst will be working closely with the leader of our Testing Program, who will help train the Test Analyst and direct activities.
The Test Analyst role will be responsible for the timely set-up and smooth running of tests. This includes managing the admin around the tests, working with internal engineers to help troubleshoot any issues, assisting with reporting, and serving as a point-of-contact for queries about the testing. This is a unique opportunity to work across a broad range of products and teams, and to have a significant impact on our customers search experience.
Accountabilities
- Setting up tests (using our internal testing tool) based on specification provided. Training will be provided.
- Checking and validating test configuration
- Trouble-shoot issues with test execution, liaising with internal engineers and search development teams as needed
- Maintenance of dashboards e.g. tracking test status and results
Qualifications
- High attention to detail
- Intermediate Excel skills
- Willing to be trained and become expert in our internal search testing platform (STF)
- Willing to develop product and domain knowledge as needed to support test set-up and validation
- Good communication skills
- Knowledge/experience of agile development methodology a plus
- Experience in data visualization or reporting a plus
- Strong analytical skills
- QA experience highly desirable
- Ability to think independently and solve problems
- Highly flexible, able to quickly adapt to changing priorities and happy to jump in and take on additional tasks as needed
- Bachelor's Degree or equivalent experience
Additional Requirements
- We operate as an agile development team, with daily stand-ups; must be able to attend daily stand-ups US-based teams (little bit of UK and South Africa) at mid-shift (4AM-12NN EST)
- As a small team, we also all pitch in as and where needed to ensure the smooth flow of work. Flexibility is therefore essential!
