Software engineering (SE) students not only need sufficient technical knowledge and problem solving ability but also social and interpersonal skills in order to be industry ready. To prepare the students for the ‘real world’ the SE educators frequently use ‘Authentic Assessment’ and ‘Project Based Learning (PBL)’ approaches in their curricula. However, the level of ‘authenticity’ should vary within PBL courses offered in different years of a degree program. In this paper, we present and discuss the results of the data collected and analyzed from the first SE course offered to the students. The aim of our research is to explore how much authenticity can be achieved in the first SE course. Our study was conducted at [anonymous university] with 64 software development project teams, totaling 229 undergraduate students. The data is collected from three semesters (2016-2018) in order to assess and monitor students performance. The course design used seven authentic assessments that focused on students skills while covering a complete software development lifecycle. The results from data analysis show that students made progress in some areas of problem solving skills, however, they struggled in their social skills (e.g. people handling skills, negotiations skills and organizational skills), understanding software quality and adaptability.