Multimodal Understanding of Visual and Textual Information through Large Language Models for Advanced Cognitive Visual Tasks (PhD)
| Program start date | Application deadline |
| 2024-07-01 | - |
| 2024-10-01 | - |
| 2025-01-01 | - |
Program Overview
The program offers a unique interdisciplinary approach with potential applications in various fields, including healthcare, robotics, and content creation.
Program Outline
Research Directions:
- Multimodal representation learning: Develop methods for joint representation learning using LLMs and computer vision techniques.
Impact:
Develop a model with potential applications in healthcare, sports, robotics, content creation platforms, assistive technologies, and more. Evaluate the model's performance and scalability on benchmark datasets and explore potential industry collaborations.
Outline:
Course Schedule:
- First year: Master-level modules in advanced computer vision, natural language processing, and machine learning.
- Second year: Research-oriented modules focusing on multimodal representation learning, content generation, and semantic understanding.
- Third year: Thesis research under the supervision of faculty members.
Individual Modules:
- Advanced Computer Vision: Topics include deep learning architectures, object detection, image segmentation, and scene understanding.
- Natural Language Processing: Topics include NLP fundamentals, language modeling, and deep learning methods for NLP tasks.
- Machine Learning: Topics include supervised learning, unsupervised learning, reinforcement learning, and deep learning models.
Assessment:
Methods:
- Continuous assessment through coursework, assignments, and presentations.
- End-of-term exams for taught modules.
- Thesis assessment by a supervisor and an external examiner.
Criteria:
- Depth of understanding of relevant concepts and theories.
- Ability to apply knowledge to solve real-world problems.
- Critical thinking and analytical skills.
- Communication and presentation skills.
- Research skills and originality.
Teaching:
Teaching Methods:
- Lectures by faculty members and guest speakers.
- Laboratory sessions and practical exercises.
- Research seminars and workshops.
- Individual supervision and feedback.
Faculty:
- Prof. Baihua Li (primary supervisor)
- Strong research team with over 30 Ph.D. students, postdoctoral researchers, and academic staff in the AI and robotics research area.
Unique Approaches:
- Interdisciplinary approach that combines computer vision and natural language processing.
- Focus on research excellence and industry collaboration.
- Access to research facilities, high-spec computing resources, and the £5.8M DigLabs research initiative.
Careers:
Potential Career Paths:
- Research Scientist in AI, computer vision, or NLP.
- Robotics Engineer.
- Software Engineer focusing on image and video processing or natural language applications.
- Data Scientist with expertise in multimodal data analysis.
- Academic researcher in computer science or related fields.
Career Opportunities:
- Research positions in companies, universities, and research institutions globally.
- Opportunities in large technology companies working on AI and machine learning solutions.
- Potential to start your own company or pursue research in an academic setting.
Other:
- The Department of Computer Science at Loughborough University has an excellent research record in AI, machine learning, robotics, computer vision, and data science.
- The successful candidate will have access to robotics and AI laboratories, high-specification computing facilities (e.g., GPUs), HPC, and £5.8M DigLabs, complementing a £9m investment in research and teaching.
- Regular supervision meetings and collaboration opportunities with a strong AI research team.
UK fee: £4,712 Full-time degree per annum International fee: £26,000 Full-time degree per annum University fees and charges can be paid in advance and there are several methods of payment, including online payments and payment by instalment. Fees are reviewed annually and are likely to increase to take into account inflationary pressures.
Loughborough University
Overview:
Loughborough University is a public research university located in Loughborough, Leicestershire, England. It is renowned for its strong academic programs, particularly in sports science, engineering, and business. The university boasts a vibrant campus life and a strong focus on research and innovation.
Student Life and Campus Experience:
Loughborough University offers a diverse and engaging campus experience. Students can participate in a wide range of extracurricular activities, including sports, societies, and volunteering opportunities. The university has a strong sporting heritage and is home to world-class facilities. Students can also enjoy a vibrant social scene with numerous bars, restaurants, and events happening on campus.
Key Reasons to Study There:
World-class facilities:
Loughborough University boasts state-of-the-art facilities, including a dedicated sports village, a modern library, and cutting-edge research labs.Strong academic reputation:
The university is consistently ranked among the top universities in the UK for its academic excellence.Vibrant campus life:
Students can enjoy a lively and diverse campus community with numerous opportunities for social interaction and personal development.Focus on research and innovation:
Loughborough University is a leading research institution, with a strong focus on tackling real-world challenges.Excellent career prospects:
Graduates from Loughborough University are highly sought after by employers, with strong career prospects in various fields.Academic Programs:
Loughborough University offers a wide range of undergraduate and postgraduate programs across various disciplines, including:
Engineering:
Aerospace, Chemical, Civil, Electrical, Mechanical, and more.Business and Economics:
Accounting, Finance, Management, Marketing, and more.Sport Science:
Exercise Science, Sports Coaching, Sports Management, and more.Humanities and Social Sciences:
Psychology, Sociology, History, and more.Science and Technology:
Chemistry, Physics, Computer Science, and more.Other:
Loughborough University has a strong commitment to sustainability and social responsibility. The university is actively working towards achieving net-zero carbon emissions and promoting inclusivity and diversity within its community.
Entry Requirements:
United Kingdom
Applicants should have, or expect to achieve, at least a 2:1 Honours degree in computer science or a related science and engineering subject. A relevant Master's degree, experience in machine learning, deep learning and computer vision, strong programming skills, and passion in interdisciplinary research and innovation will be advantages.
Afghanistan
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Masters (1-2 years) following a 3 or 4 year degree 80% / 4.0 65% / 3.25 50% / 2.5
Albania
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Diplomë e Nivelit të Pare (First Level (University) Diploma (from 2010) 5 5 8
Algeria
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Licence (4 year) / Diplome d'Inginieur d'Etat / Diplôme d'Etudes Supérieures 16 14 12
Argentina
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Licenciatura/ Licenciado (4 year) 5 5 0
Armenia
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Bakalavri Kochum required but typically a Magistrosi Kochum 90% or 3.9 80% or 3.5 70% or 3.0
Australia
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Honours degree (AQF level 8) First Class, 80% Upper Second, 70%, H2A Lower Second, 60%, 2B Ordinary degree - AQF Level 7 pass (mark 46 or 50) High Distinction (80% or 85%) Distinction (75% or 80%) Distinction (70% or 75%)
Austria
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Degree/ Diplomstudium / Magister degree A (or 1.5) mit Auszeichnungbestanden 60% or B or 3.0 (or 2) 50% or C or 2.7 (or 3)
Azerbaijan
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Bakalavr Diplomu/ Diplomu (Specialist Diploma) 5 or 90% 4 or 80% 5 or 70%
Bahamas
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Degree from University of the West Indies only 1st (GPA 3.6) 2:1 (GPA 3.0) 2:2 (GPA 2.5)
Bahrain
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) GPA 4.0 scale 5 0 8
Bangladesh
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) 4 year Bachelor of Science in Engineering (IEB and BAETE accredited courses only) 1st (70%) / 3.5 2nd (60%) / 3.0 2nd (55%) / 2.75 Masters (1-2 years) following a 3 or 4 year degree 80% / 4.0 65% / 3.25 50% / 2.5
Barbados
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) University of the West Indies, Honours degree 1st (GPA 3.6) 2:1 (GPA 3.0) 2:2 (GPA 2.5) Barbados Community College 1st or GPA 3.75 2:1 or GPA 3.5 2:2 or GPA 3.0
Belarus
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Specialist Diploma (5Yr) 9 7 5
Belgium
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Bachelor degree/Licenciaat/Licencie 80% or 17 70% or 14 60% or 12
Belize
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Degree from University of the West Indies only 1st (GPA 3.6) 2:1 (GPA 3.0) 2:2 (GPA 2.5)
Benin
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Maitrise 18 15 or Bien 12 or Assez Bien
Bermuda
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Degree from University of the West Indies only 1st (GPA 3.6) 2:1 (GPA 3.0) 2:2 (GPA 2.5)
Bolivia
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) A Licenciado, 4 years Private (public/private) 85/78 75/66 67/55
Bosnia and Herzegovina
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Diploma Visokog Obrazovanja / Diplomirani 10 9 8
Botswana
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Master's degree A or 80% B or 70% C or 60%
Brazil
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Brazil - 4 yr Bacharel or Licenciado/Licenciatura or Título Profissional 5 5 5
Brunei
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Brunei First Upper Second (60%/B/3.1) Lower Second (50%/C/2.7)
Bulgaria
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) 5 yr Diploma za Zavarsheno Visshe Obrazovanie (Diploma of Completed Higher Education) 6 5 4
Burundi
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Masters or Diplôme d'Études Approfondies or Diplôme Ingénieur (professional title) 18 15/20 (Bien) 5/20 (Assez Bien)
Cambodia
First-class honours (70%) Upper second-class honours (60%) Lower second-class honours (50%) Masters 80% or B+ or 3.5 70% or B or 3.0 60% or C+ or 2.5
Language Proficiency Requirements:
English language requirements
Applicants must meet the minimum English language requirements.
