Fine-Tuning LLM Model to Supercharge Your Model

Topic 1 Introduction to Large Language Models (LLM) and AI Agents

• Overview of transformer architecture and attention mechanisms in LLMs
• Introduction to AI agents
• NLP applications Powered by LLM and AI agents
• Use cases of LLMs and AI agents

Topic 2 Retrieval-Augmented Generation (RAG)

• Introduction to Retrieval-Augmented Generation (RAG)
• Use cases of RAG
• Overview of tokenization and word embeddings
• Overview of chunking strategies and vector databases
• Build a RAG system

Topic 3: Fundamentals of Fine Tunning LLM

• Fundamentals of LLM Fine Tuning
• Supervised Fine-Tuning (SFT) for custom LLM Tasks
• Parameter Efficient Fine Tuning (PEFT)
• Low-Rank Adaptation (LoRA) for fine tuning LLM
• Group Relative Policy Optimization (GRPO)
• Reinforcement Learning (RT Learning) for fine tunning

Topic 4 Fine Tuning LLM Implementation and Deployments

• Overview of Hugging Face Fine Tuning Libraries
• Implementing Fine Tuning wiht Hugging Face Libraires
• Using Hugging Face datasets and tokenizers for LLMs fine tunning
• Deploying and testing Fine-Tuned models

Prerequisite:

You need to have a slight familiarity with 3DS MAX Interface and Tools. It is assumed that you already know the interface, can navigate 3DS MAX viewports, and know about 3D modeling. In case you are a beginner with 3DS MAX, you may wish to start by taking a foundation course like “3DS MAX for Architectural Visualization” or “3DS MAX Modeling for Game: The Core Concepts” and then take this course.

Software Requirement:

HRDF Funding

Please refer to this video https://youtu.be/Kzpd-V1F9Xs

1-     HRD Corp Grant Helper

How to submit grant applications for HRD Corp Claimable Courses

2-     Employers are required to apply for the grant at least one week before training commences.

Employers must submit their applications with supporting documents, including invoices/quotations, trainer profiles, training schedule and course content.

3-     First, Login to Employer’s e-TRIS account -https://etris.hrdcorp.gov.my

Second, Click Application

4-     Click Grant on the left side under Applications

5-     Click Apply Grant on the left side under Applications

6-     Click Apply

7-     Choose a Scheme Code and select HRD Corp Claimable Courses: Skim Bantuan Latihan Khas. Then, click Apply

8-     Scheme Code represents all types of training that suit the requirements provided by HRD Corp. Below are the list of schemes offered by HRD Corp:

9-     Select your Immediate Officer and click Next

10-  Select a Training Provider, then click Next

11-  Please select a training programme from the list, then key in all the required details and click Next

Select your desired training programme.

Give an explanation on why the participant is required to attend the training. E.g., related to their tasks/ career development, etc.

Explain the background and objective of this training.

Select a relevant focus area. For Employer-Specific Courses, select ‘Not Applicable’.

12-  If the training programme is a micro-credential programme, you are required to complete these 3 fields. Save and click Next

Insert MiCAS Application number

13-  Based on the nine (9) pillars listed below, HRD Corp Focus Area Courses are closely tied to support government initiatives towards nation building. As such, courses offered through the HRD Corp Focus Areas are designed to provide the workforce with skills required for current and future demands. Details of the focus areas are as follows:

14-  Please select a Course Title and Type of Training

15-  Select the correct type of training according to the actual type of training, or as mentioned in the training brochure:

16-  Please key in the Training Location and click Next

17-  Please select the Level of Certification and click Next

18-  Please follow the instructions and key in trainee details

19-  Click Add Batch, then click Save

20-  Click Add Trainee Details

21-  Please key in all the required details, then click Add

22-  Click Add if there are more participants. Once done, click Save

23-  Click Next

24-  Please key in the course fees and allowance details, then click Save

25-  Estimated cost includes the course fees/external trainer fees, allowances, and consumable training materials. Please comply with the HRD Corp Allowable Cost Matrix.

26-  Select Upfront Payment to Training Provider and key in the percentage from 0% to 30%. Then, click Save and Next

27-  Complete the declaration form and select a desired officer

28-  Add all the required documents, then click Add Attachment. Then, click Save and Submit Application

29-  Once the New Grant Application is successfully submitted, the Grant Officer will evaluate the application accordingly. The application may be queried if additional information is required.

The application status will be updated via the employer’s dashboard, email, and the e-TRiS inbox.

• AI Engineer
• Machine Learning Engineer
• NLP Engineer
• LLM Fine-Tuning Specialist
• AI Research Scientist
• Data Scientist
• Deep Learning Engineer
• AI Solutions Architect
• MLOps Engineer
• AI Product Manager
• Conversational AI Developer
• AI Infrastructure Engineer
• Natural Language Processing Researcher
• AI Consultant
• Machine Learning Operations Specialist
• AI Application Developer
• Data Engineer
• AI Technical Lead
• Prompt Engineer
• AI Systems Integration Specialist

Dr. Aanand: Dr. Aanand is a Full Stack Data Scientist who once had a torrid love affair with Physics. He has consulted and published in the area of Public Health, Electricity Markets, Telecom, BFSI, Advertising & Communication Strategies and Digital & Social Media Technologies. He has worked on assignments with international agencies such as International Monetary Fund, World Bank, Royal Netherland Embassy etc. besides MNCs like Tata Consultancy Services, Kie Square Consulting and several government organizations of national importance.

He regularly conducts general training programs in Python (Pandas, NumPy, SciPy, Matplotlib, Bokeh), R (dplyr, rstanarm, knitR, ggplot2), Data Visualization (Tableau, D3.js) and Machine Learnng (Reinforced Learning, Scikit Learn) and specialized training programs on Structural Equation Modeling and SAP Hana.

He holds a doctorate in Operations Research from Indian Institute of Management Ahmedabad and a post graduate in Physics from University of Mumbai. He has advanced training in mathematical programming including optimization, advanced multivariate data analysis, and simulation techniques. When he is not teaching or consulting he can be found meditating or heading for an adventurous trek.

Amir Othman: Amir Othman is a software engineer by profession. Being educated in Bauhaus Universität Weimar and Hochschule Ulm, he brings experiences from different facades of the world.

With expertise in web technology, natural language processing and machine learning, he is a freelance data scientist. Some of his works include two international news aggregator

www.kronologimalaysia.com and www.diezeitachse.de

He also holds an impressive port folio for data visualizations, primarily focusing on web based techniques.

After the realization set in that, I do not want to make it as an electronic engineer, I took the decision to go and try something new out of pure curiosity and thirst for new adventure. It didn't come quite handy but I have changed my major three times. It's not a surprise that I studied artificial intelligence and found myself all over again. I have a strong passion for machine learning and data science, fueled by the drive to learn and the endurance for growth beyond the ordinary.

Reza Adinehnia: Reza Adinehnia is an experienced Network Security Specialist with a demonstrated history of working in IT industry. He is skilled in Data mining, VMware ESX, Database Security, C, PHP, Computer networks and security. He possesses a strong information technology background with a Doctor of Philosophy (PhD) focused in Computer Security from Universiti Putra Malaysia.

Syed Muhammad Farrukh Akhtar: Syed Muhammad Farrukh Akhtar has more than 15 years of experience analysis, designing, developing, integrating and managing large applications for diverse industries. He has experience working in Dubai, Pakistan, Germany and Malaysia, strong hands-on experience of software design, development and integration on different platform like IBM J2EE, Oracle and Microsoft .Net, Big data, Hadoop, Spark, HBase, Hive, Sqoop, Flume and NoSQL. He also has expertise in Machine Learning/ Deep Learning with Tensor Flow, Keras and Python, excellent skills in React, Ionic 2, Angular 2, Mobile Apps with React Native and Node.js.

He is highly knowledgeable in object oriented software development, requirements analysis, and database design. Possess deep understanding of Open Source technologies’ applicability in emerging business areas. He possesses excellent knowledge in Rational Unified Process (RUP); Rational Software Architect; data modeling and mapping; and extensible system design using the UML and Visio. Professional experience on J2EE, JMS, Web Sphere, Oracle, Spring, Hibernate, Struts and 3-Tier Web-based Applications Development.