Commit a3f1f1f1 authored by Carsten Eie Frigaard's avatar Carsten Eie Frigaard
Browse files

update

parent ae8b113c
......@@ -555,10 +555,33 @@ problematisk, se min metode i opgaverne.}
svært af få nok typografisk 'kvalitet' i en Jupyter Notebook aflevering.}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
CONTENT Ekstra video materiale
Offline lektioner
Nedenfor er tilføjet ekstra lektions-materiale. Dette materiale vil ikke blive gennemgået til online lektioner.
Offline lektioner:
MMLS recap og matrix vektor notation:
opsummering af matrix og vektor notationen fra 1. semester kurset 'matematisk modellering af lineære systemer'.
Hypothesis funktionen og samling af data:
Hvordan ser en ML 'black-box' ud, hvad er input, output og navngivning generelt.
The Design matrix:
hvordan data nemmere beskrives og behandles i matrix notation.
Lineær regressor:
Mere om en simple hypothesis algoritme; en lineær regressor funktion.
Træning:
Hvordan sættes data, hypothesis funktionen, dens interne parametre og tabs-funktionen (loss/cost/objective) sammen i en simple trænings/optimerings algoritme.
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
CONTENT L00
\sub{Formål} %\header{Forberedelse inden kursusstart}
......@@ -892,22 +915,19 @@ ser vi derfor til sidst på Scikit-learns Pipelines.}
\itemize{
\item{Læs litteraturen,}
\item{Forbered een eller flere af gruppe medlerne på en mundtlig repetition af \i{§ 2 End-to-End:}:}
\subitem{i skal kunne give et kort mundligt resume af hele \i{§ 2} til en anden gruppe (på nær, som nævnt, \i{Create the Workspace} og \i{Download the Data}),}
\subitem{resume holdes til konceptplan, dvs. prøv at genfortælle, hvad de overordnede linier i kaptilerne i [HOML].}
\item{Een eller flere af gruppe medlemmer forbereder et mundtlig resume af \i{§ 2 End-to-End}:}
\subitem{se detaljer i \link**{[HOME]/L03/supergruppe_diskussion.ipynb}}
}
\sub{På klassen}
\enumerate{
\item{Supergruppe [SG] resume af \i{§ 2 End-to-End}:}
\subitem{en supergruppe [SG], sammensættes af to grupper [G], on-the-fly på klassen,}
\subitem{hver gruppe [G] forbereder og giver en anden gruppe [G] et mundtligt resume af \i{§ 2} til en anden gruppe,}
\subitem{tid: ca. 30 min- sammenlagt, den ene grupper genfortæller første haldel af \i{§ 2} i ca. 15 min., hvorefter den anden gruppe genfortæller resten i ca. 15 min.}
\item{\b{Forberedt opgave:} \link**{[HOME]/L03/supergruppe_diskussion.ipynb}}
\subitem*{Supergruppe [SG] resume af \i{§ 2 End-to-End}, ca. 30 til 45 min.}
\item{Almindelig forelæsning}
\subitem*{ekstra materiale: \link**{[HOME]/L03/Extra/k-fold_demo.ipynb}}
\item{\b{Opgave} (pipelines): \link**{[HOME]/L03/pipelines.ipynb}}
\subitem*{Data til pipelines opgaven (bør lige i L03/Data/):\link**{[HOME]/L03/Data/itmal_l01_data.pkl}}
\item{\b{Opgave} (pipelines): \link**{[HOME]/L03/pipelines.ipynb}}
\subitem*{Data til pipelines opgaven (bør lige i L03/Data/): \link**{[HOME]/L03/Data/itmal_l01_data.pkl}}
\subitem*{(Du har allerede denne data-fil, hvis du pull'er fra [GITMAL])}
}
......
......@@ -9,7 +9,7 @@ COURSEFILES = ITMAL_E21
MKDIFF=printf "DIFF Ref/%-10s Test/ .. " $1 && colordiff -dw Refs/$1 Test/ && echo "DIFF OK" && rm Test/$1
build:
@ $(PYCOURSE) -c $(COURSEFILES)/course.tex -v -o ../../Html/ -t
@ $(PYCOURSE) -c $(COURSEFILES)/course.tex -v -o ../../Html/
@ $(PYPLAN) -p $(COURSEFILES)/plan.txt -v -o ../../Html/plan.html
@ cd ../.. && $(PWD)/$(PYFILETREE) -v -o Html/filetree.html
......
......@@ -466,7 +466,7 @@ if __name__ == '__main__':
outputfilename = Str(filenamebase) + sublesson + ".html"
htmlcontent = Str(htmlstructure[i])
Dbg(verbose, f" {Col('YELLOW')}WRITING '{i}' => '{outputfilename}'{ColEnd()}", 1)
Dbg(verbose, f" {Col('YELLOW')}WRITING {i:40s} => '{outputfilename}'{ColEnd()}", 1)
html = MkHtmlPage(htmlcontent) if Bool(addhtmlheaders) else htmlcontent
with Outputfile(outputfilename) as f:
......
<!DOCTYPE html>
<html>
<!-- AUTOGENERATED HTML from CourseBuilder, CEF -->
<meta http-equiv='Content-Type' content='text/html; charset=utf-8'/>
<body style='font-family: times new roman, times, serif;font-size: 12pt;color: #000000;'>
<h3>Web sites</h3>
......@@ -53,3 +58,6 @@ Guides etc.
</body>
</html>
\ No newline at end of file
<!DOCTYPE html>
<html>
<!-- AUTOGENERATED HTML from CourseBuilder, CEF -->
<meta http-equiv='Content-Type' content='text/html; charset=utf-8'/>
<body style='font-family: times new roman, times, serif;font-size: 12pt;color: #000000;'>
Der er adgang til en GPU baseret server ifbm kurset. Serveren består af en
&#x27;master&#x27; som kan tilgås via
......@@ -130,3 +135,6 @@ frigiver!</p>
</body>
</html>
\ No newline at end of file
<!DOCTYPE html>
<html>
<!-- AUTOGENERATED HTML from CourseBuilder, CEF -->
<meta http-equiv='Content-Type' content='text/html; charset=utf-8'/>
<body style='font-family: times new roman, times, serif;font-size: 12pt;color: #000000;'>
<dl>
<dt>[<b>AI</b>]:
......@@ -77,3 +82,6 @@
</body>
</html>
\ No newline at end of file
<!DOCTYPE html>
<html>
<!-- AUTOGENERATED HTML from CourseBuilder, CEF -->
<meta http-equiv='Content-Type' content='text/html; charset=utf-8'/>
<body style='font-family: times new roman, times, serif;font-size: 12pt;color: #000000;'>
<h3>Formål</h3>
......@@ -81,3 +86,6 @@ at undersøg/bruge det).</p>
</body>
</html>
\ No newline at end of file
<!DOCTYPE html>
<html>
<!-- AUTOGENERATED HTML from CourseBuilder, CEF -->
<meta http-equiv='Content-Type' content='text/html; charset=utf-8'/>
<body style='font-family: times new roman, times, serif;font-size: 12pt;color: #000000;'>
<h3>Formål</h3>
......@@ -113,3 +118,6 @@ brug for en python og lineær algebra kick-start.</p>
</body>
</html>
\ No newline at end of file
<!DOCTYPE html>
<html>
<!-- AUTOGENERATED HTML from CourseBuilder, CEF -->
<meta http-equiv='Content-Type' content='text/html; charset=utf-8'/>
<body style='font-family: times new roman, times, serif;font-size: 12pt;color: #000000;'>
<h3>Hands-on Machine Learning <span style='font-family: courier new, courier;'>[HOML]</span></h3>
......@@ -48,3 +53,6 @@ og meget brugt i ML sammenhænge.)
</body>
</html>
\ No newline at end of file
......@@ -14,6 +14,7 @@
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Demos/Py/Utils/dbg.py'>dbg.py</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Demos/Py/Utils/mkutils.py'>mkutils.py</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Demos/Py/mk_course.py'>mk_course.py</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Demos/bnf.py'>bnf.py</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Demos/demo2.py'>demo2.py</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Demos/demo3.py'>demo3.py</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Demos/demo4.py'>demo4.py</a><br></span>
......@@ -33,6 +34,7 @@
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Html/Figs/brian_holm.jpg'>brian_holm.jpg</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Html/Figs/ml_supervised_map.png'>ml_supervised_map.png</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Html/Dokumentation_og_links.html'>Dokumentation_og_links.html</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Html/Ekstra_video_materiale.html'>Ekstra_video_materiale.html</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Html/GPU_Cluster.html'>GPU_Cluster.html</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Html/Journal_afleveringsformat.html'>Journal_afleveringsformat.html</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Html/Kriterier_for_O4.html'>Kriterier_for_O4.html</a><br></span>
......@@ -64,6 +66,7 @@
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Utils/colors.py'>colors.py</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Utils/dbg.py'>dbg.py</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Utils/mkutils.py'>mkutils.py</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/M'>M</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/Makefile'>Makefile</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/course.tex'>course.tex</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Etc/CourseBuilder/mk_course.py'>mk_course.py</a><br></span>
......@@ -81,6 +84,7 @@
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Html/Figs/brian_holm.jpg'>brian_holm.jpg</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Html/Figs/ml_supervised_map.png'>ml_supervised_map.png</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Html/Dokumentation_og_links.html'>Dokumentation_og_links.html</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Html/Ekstra_video_materiale.html'>Ekstra_video_materiale.html</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Html/GPU_Cluster.html'>GPU_Cluster.html</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Html/Journal_afleveringsformat.html'>Journal_afleveringsformat.html</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/Html/Kriterier_for_O4.html'>Kriterier_for_O4.html</a><br></span>
......@@ -132,6 +136,7 @@
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/L03/Figs/ml_supervised_map.png'>ml_supervised_map.png</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/L03/lesson03.pdf'>lesson03.pdf</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/L03/pipeline.ipynb'>pipeline.ipynb</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/L03/supergruppe_diskussion.ipynb'>supergruppe_diskussion.ipynb</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/L03/train_test_split.ipynb'>train_test_split.ipynb</a><br></span>
<span style="font-family: 'courier new', courier, sans-serif">L04<br></span>
<span style="font-family: 'courier new', courier, sans-serif">&nbsp;&nbsp;&nbsp;&nbsp;<a href='https://itundervisning.ase.au.dk/ITMAL_E21/L04/gradient_descent.ipynb'>gradient_descent.ipynb</a><br></span>
......
%% Cell type:markdown id: tags:
# Supergruppe diskussion
## § 2 "End-to-End Machine Learning Project" [HOML]
Genlæs kapitel § 2 (eksklusiv "_Create the Workspace_" og "_Download the Data_"), og forbered mundtlig præsentation.
## Forberedelse inden lektionen
Een eller flere af gruppe medlemmer forbereder et mundtligt resume af § 2:
* i skal kunne give et kort mundligt resume af hele § 2 til en anden gruppe (på nær, som nævnt, Create the Workspace og Download the Data),
* resume holdes til koncept-plan, dvs. prøv at genfortælle, hvad de overordnede linier i kaptilerne i [HOML].
Lav et kort skriftlig resume af de enkelte underafsnit, ca. 5 til 20 liners tekst, se "TODO"-template herunder (MUST, til O1 aflevering).
Kapitler (incl. underkapitler):
* _Look at the Big Picture_
* _Get the Data (eksklusiv Create the Workspace og Download the Data),_
* _Discover and Visualize the Data to Gain Insights,_
* _Prepare the Data for Machine Learning Algorithms,_
* _Select and Train a Model,_
* _Fine-Tune Your Model,_
* _Launch, Monitor, and Maintain Your System,_
* _Try It Out!._
## På klassen
Supergruppe [SG] resume af § 2 End-to-End, ca. 30 til 45 min.
* en supergruppe [SG], sammensættes af to grupper [G], on-the-fly på klassen,
* hver gruppe [G] forbereder og giver en anden gruppe [G] et mundtligt resume af § 2 til en anden gruppe,
* tid: ca. 30 min- sammenlagt, den ene grupper genfortæller første haldel af § 2 i ca. 15 min., hvorefter den anden gruppe genfortæller resten i ca. 15 min.
%% Cell type:markdown id: tags:
#### Resume: Look at the Big Picture
TODO resume..
#### Resume: Get the Data (eksklusiv Create the Workspace og Download the Data)
TODO resume..
#### Resume: Discover and Visualize the Data to Gain Insights,
TODO resume..
#### Resume: Prepare the Data for Machine Learning Algorithms
TODO resume..
#### Resume: Select and Train a Model
TODO resume..
#### Resume: Fine-Tune Your Model
TODO resume..
#### Resume: Launch, Monitor, and Maintain Your System
TODO resume..
#### Resume: Try It Out!.
TODO resume..
%% Cell type:markdown id: tags:
REVISIONS | |
--------- | |
2019-01-28 |CEF, initial.
2020-02-05 |CEF, F20 ITMAL update.
2021-08-17 |CEF, E21 ITMAL update
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment