3D Computer Vision, 6 credits
3D-datorseende, 6 hp
TSBB33
Main field of study
Computer Science and Engineering Electrical EngineeringCourse level
Second cycleCourse type
Programme courseExaminer
Per-Erik ForssénDirector of studies or equivalent
Lasse AlfredssonEducation components
Preliminary scheduled hours: 101 hRecommended self-study hours: 59 h
Available for exchange students
YesMain field of study
Computer Science and Engineering, Electrical EngineeringCourse level
Second cycleAdvancement level
A1XSpecific information
The course can not be included in a degree together with TSBB15.
Course offered for
- Master of Science in Applied Physics and Electrical Engineering
- Master of Science in Applied Physics and Electrical Engineering - International
- Master of Science in Computer Science and Engineering
- Master of Science in Information Technology
- Master of Science in Computer Science and Software Engineering
Prerequisites
Probability theory, estimation theory, the least squares method.
From e.g. Multi-dimensional signal analysis: Projective spaces, homogeneous representations of 2D and 3D geometry, perspective projection, camera calibration, and epipolar geometry.
Basic image processing: thresholding, segmentation, edge detection.
Use of Python.
As half the course is project work, experience with programming is also recommended.
Intended learning outcomes
The course gives knowledge on the algorithms and estimation problems used to infer 3D structure from images. This includes both the mathematics used, and how these are put into practice in algorithm implementation.
After the course, the students should be able to:
- Goal 1: explain and use algorithms for robust estimation of geometric entities
- Goal 2: explain and use algorithms for dense correspondence fields and triangulation in stereo images
- Goal 3: explain and integrate components for structure from motion
- Goal 4: explain and integrate components for densification of 3D models
Course content
This course teaches methodology related to the goals listed above, with focus on the following:
- Robust estimation for geometry (RANSAC)
- Non-linear least squares estimation, and robust error norms
- Geometric estimation problems such as absolute and relative camera pose, and minimal cases for solvability.
- Structure from motion, bundle adjustment
- Estimation of dense correspondence fields
- Triangulation of correspondences
The contents are introduced in a lecture series, and are then put to use in computer exercises and a programming project.
Teaching and working methods
The course consists of a lecture series, two computer exercises, and a programming project conducted in groups of students. The course ends with a written exam. The computer exercises introduce key components of the project and require programming.
Examination
TEN1 | Written Examination | 2 credits | U, 3, 4, 5 |
PRA1 | Project Work | 3 credits | U, G |
LAB1 | Laboratory Work | 1 credits | U, G |
Attendance is mandatory at the computer exercises, the project presentation seminar, and at the lecture where the project starts.
The use parts of Goals 1-2 are tested during the computer exercises, and of Goals 3-4 during the project (integrate). Basic ability to explain for Goals 1-4 is tested during an oral project presentation, a written project report and an exam. Deeper understanding of Goals 1-4 are tested by the exam.
For grade 3, a pass on the project, computer exercises and the exam are required. For grades 4 and 5, in addition it is required to demonstrate, on the exam, a higher ability to explain and use methods.
Grades
Four-grade scale, LiU, U, 3, 4, 5Other information
Supplementary courses
Images and Graphics - Project Course CDIO, Machine Learning for Computer Vision
About teaching and examination language
The teaching language is presented in the Overview tab for each course. The examination language relates to the teaching language as follows:
- If teaching language is “Swedish”, the course as a whole could be given in Swedish, or partly in English. Examination language is Swedish, but parts of the examination can be in English.
- If teaching language is “English”, the course as a whole is taught in English. Examination language is English.
- If teaching language is “Swedish/English”, the course as a whole will be taught in English if students without prior knowledge of the Swedish language participate. Examination language is Swedish or English depending on teaching language.
Other
The course is conducted in a manner where both men's and women's experience and knowledge are made visible and developed.
The planning and implementation of a course should correspond to the course syllabus. The course evaluation should therefore be conducted with the course syllabus as a starting point.
The course is campus-based at the location specified for the course, unless otherwise stated under “Teaching and working methods”. Please note, in a campus-based course occasional remote sessions could be included.
If special circumstances prevail, the vice-chancellor may in a special decision specify the preconditions for temporary deviations from this course syllabus, and delegate the right to take such decisions.
Department
Institutionen för systemteknikCourse literature
Books
- Prince, Simon J. D., Verfasser, (2012) Computer vision : models, learning, and inference
ISBN: 9781107011793, 1107011795
Compendia
- Klas Nordberg, Introduction to Representations and Estimation in Geometry
LiU Compendium
Other
- Utvalda forskningsartiklar som anges på kurshemsidan.
Code | Name | Scope | Grading scale |
---|---|---|---|
TEN1 | Written Examination | 2 credits | U, 3, 4, 5 |
PRA1 | Project Work | 3 credits | U, G |
LAB1 | Laboratory Work | 1 credits | U, G |
Attendance is mandatory at the computer exercises, the project presentation seminar, and at the lecture where the project starts.
The use parts of Goals 1-2 are tested during the computer exercises, and of Goals 3-4 during the project (integrate). Basic ability to explain for Goals 1-4 is tested during an oral project presentation, a written project report and an exam. Deeper understanding of Goals 1-4 are tested by the exam.
For grade 3, a pass on the project, computer exercises and the exam are required. For grades 4 and 5, in addition it is required to demonstrate, on the exam, a higher ability to explain and use methods.
Course syllabus
A syllabus must be established for each course. The syllabus specifies the aim and contents of the course, and the prior knowledge that a student must have in order to be able to benefit from the course.
Timetabling
Courses are timetabled after a decision has been made for this course concerning its assignment to a timetable module.
Interruption in and deregistration from a course
The LiU decision, Guidelines concerning confirmation of participation in education (Dnr LiU-2020-02256), states that interruptions in study are to be recorded in Ladok. Thus, all students who do not participate in a course for which they have registered must record the interruption, such that the registration on the course can be removed. Deregistration from or interrupting a course is carried out using a web-based form Forms
Cancelled courses and changes to the course syllabus
Courses with few participants (fewer than 10) may be cancelled or organised in a manner that differs from that stated in the course syllabus. The Dean is to deliberate and decide whether a course is to be cancelled or changed from the course syllabus.
Guidelines relating to examinations and examiners
For details, see Guidelines for education and examination for first-cycle and second-cycle education at Linköping University, Dnr LiU-2020-04501 (http://styrdokument.liu.se/Regelsamling/VisaBeslut/917592).
An examiner must be employed as a teacher at LiU according to the LiU Regulations for Appointments, Dnr LiU-2021-01204 (https://styrdokument.liu.se/Regelsamling/VisaBeslut/622784). For courses in second-cycle, the following teachers can be appointed as examiner: Professor (including Adjunct and Visiting Professor), Associate Professor (including Adjunct), Senior Lecturer (including Adjunct and Visiting Senior Lecturer), Research Fellow, or Postdoc. For courses in first-cycle, Assistant Lecturer (including Adjunct and Visiting Assistant Lecturer) can also be appointed as examiner in addition to those listed for second-cycle courses. In exceptional cases, a Part-time Lecturer can also be appointed as an examiner at both first- and second cycle, see Delegation of authority for the Board of Faculty of Science and Engineering.
Forms of examination
Principles for examination
Written and oral examinations and digital and computer-based examinations are held at least three times a year: once immediately after the end of the course, once in August, and once (usually) in one of the re-examination periods. Examinations held at other times are to follow a decision of the faculty programme board.
Principles for examination scheduling for courses that follow the study periods:
- courses given in VT1 are examined for the first time in March, with re-examination in June and August
- courses given in VT2 are examined for the first time in May, with re-examination in August and January
- courses given in HT1 are examined for the first time in October, with re-examination in January and August
- courses given in HT2 are examined for the first time in January, with re-examination in March and in August.
The examination schedule is based on the structure of timetable modules, but there may be deviations from this, mainly in the case of courses that are studied and examined for several programmes and in lower grades (i.e. 1 and 2).
Examinations for courses that the faculty programme board has decided are to be held in alternate years are held three times during the school year in which the course is given according to the principles stated above.
Examinations for courses that are cancelled or rescheduled such that they are not given in one or several years are held three times during the year that immediately follows the course, with examination scheduling that corresponds to the scheduling that was in force before the course was cancelled or rescheduled.
When a course, or a written examination (TEN, DIT, DAT), is given for the last time, the regular examination and two re-examinations will be offered. Thereafter, examinations are phased out by offering three examinations during the following academic year at the same times as the examinations in any substitute course. If there is no substitute course, three examinations will be offered during re-examination periods during the following academic year. Other examination times are decided by the faculty programme board. In all cases above, the examination is also offered one more time during the academic year after the following, unless the faculty programme board decides otherwise. In total, 6 re-examinations are offered, of which 2 are regular re-examinations. In the examination registration system, the examinations given for the penultimate time and the last time are denoted.
If a course is given during several periods of the year (for programmes, or on different occasions for different programmes) the faculty programme board or boards determine together the scheduling and frequency of re-examination occasions.
Retakes of other forms of examination
Regulations concerning retakes of other forms of examination than written examinations and digital and computer-based examinations are given in the LiU guidelines for examinations and examiners, http://styrdokument.liu.se/Regelsamling/VisaBeslut/917592.
Course closure
For Decision on Routines for Administration of the Discontinuation of Educational Programs, Freestanding Courses and Courses in Programs, see DNR LiU-2021-04782. After a decision on closure and after the end of the discontinuation period, the students are referred to a replacement course (or similar) according to information in the course syllabus or programme syllabus. If a student has passed some part/parts of a closed program course but not all, and there is an at least partially replacing course, an assessment of crediting can be made. Any crediting of course components is made by the examiner.
Registration for examination
In order to take an written, digital or computer-based examination, registration in advance is mandatory, see decision in the university’s rule book https://styrdokument.liu.se/Regelsamling/VisaBeslut/622682. An unregistered student can thus not be offered a place. The registration is done at the Student Portal or in the LiU-app during the registration period. The registration period opens 30 days before the date of the examination and closes 10 days before the date of the examination. Candidates are informed of the location of the examination by email, four days in advance.
Code of conduct for students during examinations
Details are given in a decision in the university’s rule book: http://styrdokument.liu.se/Regelsamling/VisaBeslut/622682.
Retakes for higher grade
Students at the Institute of Technology at LiU have the right to retake written examinations and digital and computer-based examinations in an attempt to achieve a higher grade. This is valid for all examination components with code “TEN”, “DIT” and "DAT". The same right may not be exercised for other examination components, unless otherwise specified in the course syllabus.
A retake is not possible on courses that are included in an issued degree diploma.
Grades
The grades that are preferably to be used are Fail (U), Pass (3), Pass not without distinction (4) and Pass with distinction (5).
- Grades U, 3, 4, 5 are to be awarded for courses that have written or digital examinations.
- Grades Fail (U) and Pass (G) may be awarded for courses with a large degree of practical components such as laboratory work, project work and group work.
- Grades Fail (U) and Pass (G) are to be used for degree projects and other independent work.
Examination components
The following examination components and associated module codes are used at the Faculty of Science and Engineering:
- Grades U, 3, 4, 5 are to be awarded for written examinations (TEN) and digital examinations (DIT).
- Examination components for which the grades Fail (U) and Pass (G) may be awarded are laboratory work (LAB), project work (PRA), preparatory written examination (KTR), digital preparatory written examination (DIK), oral examination (MUN), computer-based examination (DAT), home assignment (HEM), and assignment (UPG).
- Students receive grades either Fail (U) or Pass (G) for other examination components in which the examination criteria are satisfied principally through active attendance such as tutorial group (BAS) or examination item (MOM).
- Grades Fail (U) and Pass (G) are to be used for the examination components Opposition (OPPO) and Attendance at thesis presentation (AUSK) (i.e. part of the degree project).
In general, the following applies:
- Mandatory course components must be scored and given a module code.
- Examination components that are not scored, cannot be mandatory. Hence, it is voluntary to participate in these examinations, and the voluntariness must be clearly stated. Additionally, if there are any associated conditions to the examination component, these must be clearly stated as well.
- For courses with more than one examination component with grades U,3,4,5, it shall be clearly stated how the final grade is weighted.
For mandatory components, the following applies (in accordance with the LiU Guidelines for education and examination for first-cycle and second-cycle education at Linköping University, http://styrdokument.liu.se/Regelsamling/VisaBeslut/917592):
- If special circumstances prevail, and if it is possible with consideration of the nature of the compulsory component, the examiner may decide to replace the compulsory component with another equivalent component.
For possibilities to alternative forms of examinations, the following applies (in accordance with the LiU Guidelines for education and examination for first-cycle and second-cycle education at Linköping University, http://styrdokument.liu.se/Regelsamling/VisaBeslut/917592):
- If the LiU coordinator for students with disabilities has granted a student the right to an adapted examination for a written examination in an examination hall, the student has the right to it.
- If the coordinator has recommended for the student an adapted examination or alternative form of examination, the examiner may grant this if the examiner assesses that it is possible, based on consideration of the course objectives.
- An examiner may also decide that an adapted examination or alternative form of examination if the examiner assessed that special circumstances prevail, and the examiner assesses that it is possible while maintaing the objectives of the course.
Reporting of examination results
The examination results for a student are reported at the relevant department.
Plagiarism
For examinations that involve the writing of reports, in cases in which it can be assumed that the student has had access to other sources (such as during project work, writing essays, etc.), the material submitted must be prepared in accordance with principles for acceptable practice when referring to sources (references or quotations for which the source is specified) when the text, images, ideas, data, etc. of other people are used. It is also to be made clear whether the author has reused his or her own text, images, ideas, data, etc. from previous examinations, such as degree projects, project reports, etc. (this is sometimes known as “self-plagiarism”).
A failure to specify such sources may be regarded as attempted deception during examination.
Attempts to cheat
In the event of a suspected attempt by a student to cheat during an examination, or when study performance is to be assessed as specified in Chapter 10 of the Higher Education Ordinance, the examiner is to report this to the disciplinary board of the university. Possible consequences for the student are suspension from study and a formal warning. More information is available at Cheating, deception and plagiarism
Regulations (apply to LiU in its entirety)
The university is a government agency whose operations are regulated by legislation and ordinances, which include the Higher Education Act and the Higher Education Ordinance. In addition to legislation and ordinances, operations are subject to several policy documents. The Linköping University rule book collects currently valid decisions of a regulatory nature taken by the university board, the vice-chancellor and faculty/department boards.
LiU’s rule book for education at first-cycle and second-cycle levels is available at http://styrdokument.liu.se/Regelsamling/Innehall/Utbildning_pa_grund-_och_avancerad_niva.
Books
ISBN: 9781107011793, 1107011795
Compendia
LiU Compendium
Other
Note: The course matrix might contain more information in Swedish.
I | U | A | Modules | Comment | ||
---|---|---|---|---|---|---|
1. DISCIPLINARY KNOWLEDGE AND REASONING | ||||||
1.1 Knowledge of underlying mathematics and science (G1X level) |
|
|
X
|
TEN1
LAB1
|
Linear algebra, Calculus, Signal processing, Projective Geometry |
|
1.2 Fundamental engineering knowledge (G1X level) |
X
|
X
|
X
|
TEN1
LAB1
|
Projective geometry, least squares model fitting |
|
1.3 Further knowledge, methods, and tools in one or several subjects in engineering or natural science (G2X level) |
X
|
X
|
X
|
TEN1
LAB1
|
Correspondence fields, Robust model fitting, Structure from motion, Bundle Adjustment |
|
1.4 Advanced knowledge, methods, and tools in one or several subjects in engineering or natural sciences (A1X level) |
X
|
X
|
X
|
TEN1
|
||
1.5 Insight into current research and development work |
X
|
X
|
X
|
TEN1
|
The course uses recent techniques, and we have guest lectures from the industry |
|
2. PERSONAL AND PROFESSIONAL SKILLS AND ATTRIBUTES | ||||||
2.1 Analytical reasoning and problem solving |
|
X
|
X
|
PRA1
LAB1
|
Planning and execution of a group project |
|
2.2 Experimentation, investigation, and knowledge discovery |
|
|
X
|
PRA1
|
Tests and comparisons of alternative approaches |
|
2.3 System thinking |
|
X
|
X
|
PRA1
LAB1
|
Software design and integration |
|
2.4 Attitudes, thought, and learning |
|
|
X
|
PRA1
|
Personal responsibility for specific project parts |
|
2.5 Ethics, equity, and other responsibilities |
|
|
X
|
PRA1
|
Planning and execution of a group project |
|
3. INTERPERSONAL SKILLS: TEAMWORK AND COMMUNICATION | ||||||
3.1 Teamwork |
|
|
X
|
PRA1
|
Planning and execution of a group project |
|
3.2 Communications |
|
|
X
|
PRA1
|
Written and oral presentation of project results, and feedback on an other group's work |
|
3.3 Communication in foreign languages |
|
|
X
|
TEN1
PRA1
LAB1
|
When the course is given in English. |
|
4. CONCEIVING, DESIGNING, IMPLEMENTING AND OPERATING SYSTEMS IN THE ENTERPRISE, SOCIETAL AND ENVIRONMENTAL CONTEXT | ||||||
4.1 External, societal, and environmental context |
|
|
|
|||
4.2 Enterprise and business context |
X
|
|
|
We have guest lectures from the industry |
||
4.3 Conceiving, system engineering and management |
X
|
X
|
|
PRA1
|
A project plan is written in the project |
|
4.4 Designing |
X
|
X
|
|
PRA1
|
Project work |
|
4.5 Implementing |
X
|
X
|
|
PRA1
|
Project work |
|
4.6 Operating |
|
|
|
|||
5. PLANNING, EXECUTION AND PRESENTATION OF RESEARCH DEVELOPMENT PROJECTS WITH RESPECT TO SCIENTIFIC AND SOCIETAL NEEDS AND REQUIREMENTS | ||||||
5.1 Societal conditions, including economic, social, and ecological aspects of sustainable development for knowledge development |
|
|
|
|||
5.2 Economic conditions for knowledge development |
|
|
|
|||
5.3 Identification of needs, structuring and planning of research or development projects |
|
|
|
|||
5.4 Execution of research or development projects |
|
|
|
|||
5.5 Presentation and evaluation of research or development projects |
|
|
|
This tab contains public material from the course room in Lisam. The information published here is not legally binding, such material can be found under the other tabs on this page.
There are no files available for this course.