EE5434 final project 
 
Data were available on Nov. 5 (see the Kaggle website) 
Report and source codes due: 11:59PM, Dec. 6th 
Full mark: 100 pts. 
 
During the process, you can keep trying new machine learning models and boost the learning 
accuracy. 
 
You are encouraged to form groups of size 2 with your classmates so that the team can 
implement multiple learning models and compare their performance. If you cannot find any 
partners, please send a message on the group discussion board and briefly introduce your 
expertise. If you prefer to do this project yourself, you can get 5 bonus points. 
 
Submission format: Report should be in PDF format. Source code should be in a notebook file 
(.ipynb) and also save your source code as a HTML file (.html). Thus, there are three files you 
need to upload to Canvas. Remember that you should not copy anyone’s codes, which can lead 
to faisure of this course. 
 
Files and naming rules: If you have two members in the team, start the file name with G2, 
otherwise, G1. For example, you have a teammate and the team members are: Jackie Lee and 
Xuantian Chan, name it as G2-Lee-Chan.xxx. 5 pts will be deducted if the naming rule is not 
followed. In your report, please clearly show the group members. 
 
How do we grade your report? We will consider the following factors. 
 
 1. You would get 30% (basic grade) if you correctly applied two learning models to our 
classification problem. The accuracy should be much better than random guess. Your 
report is written in generally correct English and is easy to follow. Your report should 
include clear explanation of your implementation details and basic analysis of the 
results. 
2. Factors in grading: 
a. Applied/implemented and compared at least 2 different models. You show good 
sense in choosing appropriate models (such as some NLP related models). 
b. For each model, clear explanation of the feature encoding methods, model 
structure, etc. Carefully tuned multiple sets of parameters or feature engineering 
methods. Provided evidence of multiple methods to boost the performance. 
c. Consider performance metrics beyond accuracy (such as confusion matrix, recall, 
ROC, etc.). Carefully compare the performance of different 
methods/models/parameter sets. Being able to present your results using the most 
insightful means such as tables/figures etc. 
d. Well-written reports that are easy to follow/read. 
e. Final ranking on Kaggle.  For each of the factor, we have unsatisfactory (1), acceptable (2), satisfactory (3), good (4), 
excellent (5). The sum of each factor will determine the grade. For example, student A got 4 
good and 1 acceptable for a to e. Then, A’s total score is 4*4+2=16. The full mark for a to e is 
25. So, A’s percentage is 64%. 
 
 
Note that if the final performance is very close (e.g. 0.65 vs 0.66), the corresponding 
submissions belong to the same group in the ranking. 
 
Factors that can increase your grade: 
1. You used a new learning model/feature engineering method that was not taught in 
class. This requires some reading and clear explanation why you think this model fits this 
problem. 
2. Your model’s performance is much better than others because of a new or optimized 
method. 
 
The format of the report 
1. There is no page limit for the report. If you don’t have much to report, keep it simple. 
Also, miminize the language issues by proofreading. 
2. To make our grading more standard, please use the following sections: 
a. Abstract. Summarize the report (what you done, what methods you use and the 
conclusions). (less than 300 words) 
b. Data properties (data explortary analysis). You should describe your 
understanding/analysis of the data properties. 
c. Methods/models. In this section, you should describe your implemented models. 
Provide key parameters. For example, what are the features? If you use kNN, 
what is k and how you computed the distance? If you use ANN, what is the 
architecture, etc. You should separate the high-level description of the models 
and the tuning of hyper-parameters. 
d. Experimental results. In this section, compare and summarize the results using 
appropriate tables/figures. Simplying copying screening is acceptable but will 
lead to low mark for sure. Instead, you should *summarize* your results. You 
can also compare the performance of your model under different 
hyperparameters. 
e. Conclusion and discussion. Discussion why your models perform well or poorly. 
f. Future work. Discuss what you could do if more time is given. 
3. For each model you tried, provide the codes of the model with the best performance. In 
your report, you can detail the performance of this model with different parameters. 
 
The code 
The code should include: 
1. Preprocessing of the data 2. Construction of the model 
3. Training 
4. Validation 
5. Testing 
6. And other code that is necessary 
 
This is the link that you need to use to join the competition. 
https://www.kaggle.com/t/79178536956041b8acb64b6268afb4de 
 
 
 
請加QQ：99515681  郵箱：99515681@qq.com   WX：codinghelp