Find Jobs
Hire Freelancers

Performance Testing Scripts for LLMs

$30-250 USD

In Progress
Posted 14 days ago

$30-250 USD

Paid on delivery
I need a skilled individual to develop performance testing scripts in Python for Colab and Jupyter notebook. The performance metrics that the scripts should measure are: F1 score, Perplexity, Accuracy, and BLEU score. These metrics can be found in the provided GitHub link. Ideal skills and experience for this job include: - Proficiency in Python, Jupyter-notebook, and Colab - Experience with performance testing and metrics - Ability to create scripts that accurately measure the metrics provided - Experience with NLP tasks and language models would be a plus [login to view URL] LLM: mixtral and Korean Datasets
Project ID: 38040972

About the project

25 proposals
Remote project
Active 12 days ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Presently, I rank among the top 50 experts on AI StackExchange, showcasing my commitment to staying at the forefront of industry knowledge([login to view URL]). Additionally, I am nearing completion of a groundbreaking paper on a sports prediction architecture, for which I am the sole author. This project combines innovative deep learning models with classic ML techniques, underlining my ability to integrate diverse methodologies for impactful solutions. My problem-solving proficiency spans a wide spectrum, from computer vision to deep reinforcement learning, with a focus on algorithmic trading. I possess a robust foundation in linear algebra, probability, set theory, and various mathematical concepts. My expertise in ML algorithms encompasses both traditional methods (linear CoF, random forests, SVMs) and cutting-edge approaches (capsule networks, ANNs, pointer networks, and transformers). Therefore, I can reason about the optimality of a particular architecture with respect to a given problem domain. My versatility extends to applying deep learning to tabular problems and predicting stress on unlabeled structured data in an unsupervised context. I am intimately familiar with the latest NLP models used in the field today(Llama 3,GPT-4,Bard), and have expressly used them for this purpose in multiple projects(as well as prompting techniques) . I look forward to our discussion! Thanks, Austin
$200 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, As an experienced developer with over 5 years of expertise, I'm well-equipped to provide valuable feedback for your article. I possess strong English proficiency and have access to both a laptop and a stable internet connection. I'll ensure to offer comprehensive and unbiased feedback to aid your review process effectively. Let's connect over chat to discuss the project details further, so we have a thorough understanding of the requirements. Looking forward to the opportunity to collaborate with you on this project. Cheers,
$140 USD in 7 days
0.0 (0 reviews)
0.0
0.0
25 freelancers are bidding on average $160 USD for this job
User Avatar
I am a Python developer with expertise in Jupyter-notebook and Colab, and I can develop performance testing scripts to measure F1 score, Perplexity, Accuracy, and BLEU score. I have experience in creating accurate scripts for performance testing metrics and working with NLP tasks and language models. I am familiar with the provided GitHub link and can deliver the required scripts efficiently.
$250 USD in 2 days
5.0 (177 reviews)
7.8
7.8
User Avatar
Greetings, Thank you for considering my application for this project. As an AI Engineer and Developer with over 8+ years of experience, I bring a wealth of knowledge and expertise in the field of Deep Learning. I have carefully reviewed the project description and am eager to discuss your specific needs and requirements in more detail. My commitment is to provide dedicated support and consistent follow-up throughout the project's lifecycle. Please feel free to reach out to me to further discuss how I can contribute to the success of your project. Looking forward to the opportunity of working together. Best regards, KuroKien
$130 USD in 1 day
4.9 (225 reviews)
6.6
6.6
User Avatar
Hi there, I checked your requirements and guarantee you that i have relevant experience in Python and ML it's gonna be done within the highest quality . Let's contact via chat so that I can start work immediately
$180 USD in 1 day
4.9 (31 reviews)
5.5
5.5
User Avatar
Subject: Proposal for - ‘’Performance Testing Scripts for LLMs.’’ Hello there, ***Python Expert is Here*** I’ve read your description also I’ve checked your attached file carefully and I’m damn sure that I can do this task perfectly. As a professional Python Expert that I can deliver this task perfectly within a very short period of time and cost with High Quality work. Because of that with more than 10 years of expertise, I’ve done a lot of Python project based on ✔Django, ✔Pandas, ✔Flask, ✔FastAPI, ✔Jupyter Notebook, ✔Automation, ✔Selenium & etc. on various platform. You can visit my profile and check the Reviews of my previous all Python Project so that you can get the idea about my knowledge and skills. I’m ready to be hired or ready to be awarded as I can start this task Right Now. So, I’m waiting for your response. Thanks in advanced!
$50 USD in 2 days
5.0 (55 reviews)
5.3
5.3
User Avatar
Hi Sir, This is my necessary bid.I have 5 years of experience in python, performance testing,NLP.I can work for this. Let's connect.
$100 USD in 3 days
4.9 (44 reviews)
4.7
4.7
User Avatar
It's Asad Ali and, I'm Running a software house company named "CodeDebuggers". We have a team of experienced web developers, and, designers who're skilled in the following skills sets; ✔ JAVA ✔ Flutter ✔ Mobile Apps ✔ Management System ✔ PHP ✔ Laravel ✔ Codeigniter ✔ and, many more. Let's discuss your project details and requirements to get started working on amazing things together.
$140 USD in 7 days
5.0 (11 reviews)
4.8
4.8
User Avatar
As the CEO of Fx is Ai, I am confident that my team at F(x) Data Labs can provide an exceptional solution for your project. Our deeply-rooted focus on artificial intelligence, machine learning and natural language processing makes us highly qualified for this particular job. In fact, Python - a fundamental tool you require - happens to be one of our core competencies. Moreover, our solid experience in delivering over 400 successful projects demonstrates our profound understanding of project requirements and outcome-oriented approach. Beyond these necessary skills, we are well-versed in performance testing, which will enable us to develop relevant and accurate scripts for measuring the metrics provided in your GitHub link. Additionally, though not explicitly mentioned in the project description, our aptitude in NLP tasks and language models serves as the cherry on top when it comes to handling LLMs (mixtral and Korean datasets). Finally, our commitment extends beyond just providing solutions. We strive to be valuable partners invested in each client's growth story. With my agency’s unique approach and dedication towards solving complex challenges, choosing us would be more than just adding a capable programmer to your team - it would mean acquiring a tech-savvy partner genuinely interested in contributing to your success. Note: This estimate is tentative in terms of both time and rate. It is subject to change based on the specific requirements and timeline provided.
$160 USD in 7 days
4.9 (7 reviews)
4.6
4.6
User Avatar
Hi, ! I have worked with similar projects so that I can provide you with a satisfied result. Having confirmed the job posting " Performance Testing Scripts for LLMs", I truly feel that you're looking for ambitious, creative and nice people who are expert in Python, Software Architecture, Machine Learning (ML), Statistics and Java. I am fully available to get started on your project immediately and you will find it interesting to discuss the project details. Regards Nina.
$200 USD in 2 days
5.0 (2 reviews)
3.8
3.8
User Avatar
Hello After checking the job posting - Performance Testing Scripts for LLMs, I felt that your project was similar to one I had worked on before. I have undertaken similar projects to ensure I can provide you with satisfactory results. I can start your project right away and you would be interested in discussing the project details. Thank you for taking the time to review our letter. I look forward to hearing from you regarding further steps. thank you Paulo
$250 USD in 7 days
5.0 (1 review)
3.4
3.4
User Avatar
How are you? I hope this proposal finds you in good spirits and ready for some fun! I have extensive skills at Machine Learning (ML), Statistics, Software Architecture, Java and Python We are thrilled to submit a bid proposal for the fine-tuning of the GPT-3.5. So, let's dive into the world of GPT and make it even more awesome! I am a professional AI expert with strong experience in this field with OpenAI's GPT models, ChatGPT, Bard and LLaMA. I have already developed many many GPT projects including Slack Bot, Legal Consulting Bot for some Companies suing Open AI' GPT-3.5-turbo-16k and Whisper and fine tuned models of Hugging Face. I mastered HTML, Python, Java, JavaScript, PHP and have also strong expertise in Self-driving, Object Detection/Tracking using yolov series and OpenCV and Image recognition/classification, Image generation and segmentation using deeplearning like deeplab, u2net and so on. I have checked your links very carefully, so I am confident in your work, and can fine tune GPT-3.5 with your own data. I am excited about the opportunity to contribute to your project. My passion for emerging technologies, combined with my strong technical skills, make me a valuable asset to you. Thank you for considering my application. I look forward to the opportunity to discuss how I can contribute to your success. Sincerely
$200 USD in 7 days
5.0 (2 reviews)
3.2
3.2
User Avatar
Hi , Good morning! My name is Jane a skilled Statistician with skills including Java, Machine Learning (ML), Software Architecture, Statistics and Python. I have over 5 years in tutoring data analysis and statistics. Having completed similar project, I am confident in my ability to deliver high-quality results for this project. I am eager to discuss further details and see how I can contribute to your project. I am happy to offer a free consultation and a 10% discount for first-time clients. Please contact me to discuss more regarding this project. Regards Jane
$140 USD in 3 days
4.9 (4 reviews)
2.8
2.8
User Avatar
With my 12 years of experience in the field of artificial intelligence, I am highly skilled and capable of carrying out the task at hand flawlessly. I am proficient in Python and have extensive knowledge about Jupyter Notebooks and Colab- making me apt for this performance-testing project. My expertise lies in a wide range of areas, including machine learning, deep learning, and image processing; all-important components to accomplish your goals. Specifically, I have hands-on experience using libraries like TensorFlow, Keras, PyTorch, OpenCV for NLP tasks, making note of the Language models as a plus point for your project. I am also conversant with big data technologies such as Hadoop and Spark, which could be important when processing your datasets. Moreover, having worked with RESTful APIs I can effortlessly integrate the performance-testing scripts that we create into web and mobile applications. In conclusion, partnering with me promises a rare combination of expertise in performance testing, machine learning - especially NLP tasks coupled with language models - and working with large datasets on platforms like Colab and Jupyter-notebooks. My commitment to ensuring high accuracy levels will help provide you the invaluable insights your project requires. Let's not miss the opportunity to improve the quality and efficiency of your LLMs.
$240 USD in 7 days
4.8 (8 reviews)
2.8
2.8
User Avatar
Hello! Greetings, Having carefully reviewed your project description, I am confident in my ability to execute this project to perfection. I possess a broad spectrum of skills, knowledge, and experience in this specific field, making me the ideal candidate to handle your project. My proficiency includes Machine Learning (ML), Java, Python, Statistics and Software Architecture, which positions me as the best choice for the successful completion of your project. While I am well-prepared to begin, I have a few clarifying questions. Kindly drop me a message in the chat so that we can engage in a discussion regarding the project's budget and deadline. Thank you, and I look forward to the opportunity to collaborate on your project.
$200 USD in 3 days
5.0 (1 review)
2.4
2.4
User Avatar
We are ready to start right now by utilizing our expertise in Python, Jupyter notebook, and Colab to develop precise performance testing scripts that measure F1 score, Perplexity, Accuracy, and BLEU score. With experience in performance testing and a keen understanding of NLP tasks, we ensure that the metrics obtained from the provided GitHub link meet your expectations and requirements. Let our skills speak for you as we strive to deliver optimal solutions tailored to your needs. We encourage you to review our portfolio and feedback to gain more insight into our expertise. We would be more than happy to discuss your project in more detail. Please feel free to start a chat with me .
$140 USD in 7 days
4.8 (1 review)
1.7
1.7
User Avatar
I hope you are doing well. I noticed that you are interested in training/finetuning the LLAMA3 8B model on a book. My name is ikhlaq ahmed, and I am an experienced ML and AI Engineer and Developer. I would be delighted to assist you with this task. There are two approaches to achieve this: 1. Finetuning the model by converting the data into a semi-supervised format - this method is costly and requires GPU resources. 2. Utilizing the model within the Retrieval Augmented Framework (RAG) - this approach is cost-effective and scalable. Both methods offer the capability to ask specific questions about the book and engage in conversation. With the second approach, you have the option to upload multiple books to the memory of the model, but the choice is yours.
$250 USD in 7 days
5.0 (1 review)
1.6
1.6
User Avatar
InstantQuality─── ⋆⋅☆⋅⋆ ── I am a specialized Master's degree holder equipped to tackle writing across various subjects. My commitment to work is unwavering, ensuring TOP RATED EXPERT delivers consistent and high-quality writing while strictly adhering to copyright regulations. With extensive experience in the industry since 2013, I am a seasoned professional. Client satisfaction is paramount, and I am open to multiple revisions until your contentment is achieved. Access to ample journals aids in comprehensive research projects. Despite low budget constraints, I take pride in offering quality work at very reasonable rates. Specializing in various writing tasks such as ARTICLE WRITING, REPORT WRITING, ESSAY WRITING, RESEARCH PAPERS, BUSINESS PLAN, TECHNICAL WRITING, MATLAB, THESIS, ACCOUNTING & FINANCE, etc. Best regards
$30 USD in 1 day
5.0 (1 review)
1.8
1.8
User Avatar
Affordable, Early Delivery. ★★★★★★★★★★★★★★I hold a Masters degree which gives me the requisite background to handle writing from various subjects. I am a highly committed person towards my work. You can rely on QualityXenter for quality and consistency in writing. We never violate copyright rules. I have vast amount of experience in this industry since I am working from 2015 as a professional writer. I provide many modifications till to get your satisfactions. I have access to enough journals to use in your research project. I always produce quality work at VERY LOW RATES so, don't worry if you have a low budget for your work, I will be very happy to make a new client like you. I am producing quality work for my clients including ARTICLE WRITING, REPORT WRITING, ESSAY WRITING, RESEARCH PAPERS, BUSINESS PLAN, TECHNICAL WRITING, MATLAB, THESIS, ACCOUNTING & FINANCE work ETC. Go through my profile link https://www.freelancer.com/u/qualityxenter
$30 USD in 1 day
5.0 (1 review)
1.5
1.5
User Avatar
Hello, With over 5 years of extensive experience in AI, ML, DL, Python, GPT, and Chatbot development, I am well-equipped to develop performance testing scripts in Python for Colab and Jupyter notebooks. Proficient in Python, Jupyter-notebook, and Colab, I will accurately measure performance metrics such as F1 score, Perplexity, Accuracy, and BLEU score, leveraging my expertise in NLP tasks and language models. Let's connect over chat to discuss the project details further, so we have a thorough understanding of the requirements. Looking forward to the opportunity to collaborate with you on this project. Cheers,
$140 USD in 7 days
5.0 (1 review)
0.9
0.9
User Avatar
Drawing from my extensive experience in software development, particularly mobile and web applications, I am equipped with a diverse skill set that includes proficiency in Python, Jupyter-notebook, and Colab as mandated by your project. My past projects have encompassed a broad range of tasks including performance testing and metrics analysis which aligned me with a deep level of understanding for such requirements. This experience has equipped me to create accurate scripts that capture F1 score, Perplexity, Accuracy and BLEU score metrics similar to what your project necessitates. Moreover, my proficiency in handling NLP tasks ideally suits your requirement of someone familiar with language models. Although not explicitly mentioned in your description, I am also adept at working with large datasets like the LLM: mixtral and Korean datasets mentioned on the GitHub link you provided. Your satisfaction is key to my work ethic. Be it iOS or Android mobile app development or a web application that mandates measuring pivotal performance indicators as required by your project; my goal remains the same - to build something that exceeds expectations. So let's connect our ideas and transform them into reality!
$100 USD in 20 days
5.0 (1 review)
0.5
0.5
User Avatar
Drawing from my extensive experience in both performance testing and Python, I am confident in my ability to develop the required performance testing scripts for your LLM project. I have a deep knowledge of tools such as Jupyter-notebook and Colab, which I will expertly utilize to measure the performance metrics you have specified—F1 score, Perplexity, Accuracy, and BLEU score. Beyond fulfilling your technical requirements, my mastery in NLP tasks and language models further sets me apart. This domain-specific expertise will enable me to go above and beyond what is expected. In conjunction with this, I am genuinely passionate about deciphering complex datasets and believe in the immense value they hold for driving business growth. Choosing me for this project guarantees not only quality deliverables but also a collaborative partnership that fosters a positive work environment. With every task assigned to me, I strive for open and transparent communication, upholding deadlines and exceeding expectations. Let's combine our skills to unveil meaningful insights from your data that will propel your project to new heights.
$120 USD in 2 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of KOREA, REPUBLIC OF
Ulsan, Korea, Republic of
5.0
1
Payment method verified
Member since Jun 1, 2023

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.