Prompt Testing Assistant
Blue Oak Consulting
Remote
About Blue Oak Consulting
Blue Oak Consulting provides independent advisory on pricing, portfolio economics, capital allocation, and acquisition assumptions. We are not a traditional consulting firm focused on broad transformation programs or high level strategy decks. Instead, we interrogate specific commercial decisions where the financial stakes are high and the existing narrative is not sufficient. Our team looks past corporate language and P&L complexity to identify where value is leaking or capital is trapped. We work across sectors like software, manufacturing, and healthcare to test whether the assumptions behind a growth plan or an acquisition actually hold under pressure. We are a small, principal led firm where the people who do the work are the ones accountable for the results. We do not take transaction contingent fees, which allows us to be completely honest about whether the economics of a decision make sense. Our goal is to provide clarity through financial discipline and a healthy amount of skepticism.
The Role
As a Prompt Testing Assistant, you will support our research projects from your own remote workspace. The firm uses specialized tools to process large sets of commercial and financial data, and we need a focused individual to test how these systems respond to different instructions. This is not a creative writing role; it is a role centered on empirical testing and validation. You will spend your time checking for consistency, identifying where logic fails, and documenting how technical tools handle complex financial queries. Because this is a remote, part-time role, you will have the flexibility to manage your schedule while contributing to high stakes advisory work.
What You Will Be Doing
- Inputting specific financial and commercial scenarios into text models to observe the quality of the findings.
- Testing how different phrasing affects the accuracy of technical and numerical responses.
- Identifying and logging instances where the system provides incorrect or logically inconsistent data.
- Comparing program outputs against verified financial spreadsheets to ensure calculation accuracy.
- Organizing test results into clear, internal summaries for the senior team to review.
- Collaborating with principals to refine the logic used in our proprietary research prompts.
- Maintaining a detailed log of system behavior across different industries such as healthcare and manufacturing.
- Running repeated tests on the same datasets to ensure results remain stable and reliable over time.
- Flagging instances where the language used by the tool becomes overly abstract or diagnostic rather than factual.
- A background in finance, economics, or a related field where you developed a skeptical eye for data.
- High attention to detail and the ability to spot subtle errors in written or numerical reports.
- Familiarity with spreadsheet software and a general interest in how information tools process data.
- Clear, concise writing skills to document findings without using unnecessary corporate jargon.
- The ability to work independently and manage your own time in a fully remote setup.
- An inquisitive mindset that asks why a result was produced rather than just accepting it as correct.
- A willingness to perform repetitive tasks with a consistent level of concentration and precision.
- A reliable internet connection and a professional approach to meeting intermittent deadlines.
- The flexibility of a fully remote role that fits alongside other professional commitments or studies.
- Direct exposure to the analytical methods used by senior advisors in high stakes financial cases.
- Competitive pay for the role and market that reflects the specialized nature of the testing work.
- Training on how to approach technical testing from a disciplined, commercial perspective.
- A working culture that values honesty and technical accuracy over corporate posturing.
- Practical experience in the growing field of reliability testing and commercial quality assurance.