Progress

  • 14/01/2014 - Emailed Orion Health to work with them.
  • 21/01/2014 - Got a reply from thge Vice President for Product Development stating they would love to work with me.
  • 07/01/2014 - Got Introduced to my mentor via email by VP Product Development.
  • 14/01/2014 - Emailed Orion Health to work with them.
  • 20/01/2014 - First face to face meeting with my mentor discussing the scope of the project
  • 14/01/2014 - Emailed Orion Health to work with them.
  • 03/03/2014 - I wrote out the project proposal to send to Mano.
  • 05/03/2014 - Project approved from Mano and introduced Mano and my mentor via email.
  • 28/03/2014 - Meeting cancled, supervisor had to fly on a business trip.
  • 28/03/2014 - Introduced to another 2 mentors via email.
  • 28/03/2014 - Suggested to get coding concepts.
  • 22/05/2014 - Meeting with Supervisor and introduced to Grace and Amy who is the Quality Consultant and Complaint Administrator. Discussed the basic concept what the current system back end - that the data is stored in a transactional database on SQL Severver 2008. They query from that and use Excel or Tablau to generate reports. Discovered that there is a need for an ETL process to make the data more stuctured in general and for reporting purposes. We set 2 goals for the project which we will focus on:
    1. ETL - to Store data, fill Database and Fetch
    2. Reporting - SQL, Visualization
    As well as the goals of the project, we planned out my next steps for the project which was to:
    1. Use w3schools to brush up on my SQL skills
    2. Find ETL Techniques

    3. 25/05/2014 to 26/07/2014 - Until this date I had been researching on the types of ETL techniques and schemas to use that will be more suitable for this project. I have researched Microsoft SQL server, Business Intelligence Developement studio, Oracle Enterprise Edition, Tableau, Informatica and Oracle publisher and also preparing for final exams.
    4. 28/06/2014 to 26/07/2014 - Have been learning SQL from w3school website. Planned out basic steps in which I will preform the ETL process which was: Data will be extracted from the current transactional database into another database where we can query and preform calculations based on what information is required in the final destination for reporting. Then load this into a star schema where fact tables and dimensions can be used. I used many websites including this one to get an idea of how that works as well http://dc302.4shared.com/doc/TzZepofs/preview.html. Using the star schema will make it easier for querying when it comes to reporting. I could only work on what goes in the fact tables in the star schema once I get to understand the information to be extracted and also after seeing the data file.
    5. 24/07/2014 - Meeting: I recieved the data I will be working on in CSV files and discused the 1st phase of the implementation which was using SSIS. I also received an expected output which I am meant to work towards and should end up with the same columns. The data which was the result was not shown so this was a rough idea of what they wish to end up with. They created the expected output using their current system by querying using a search feature on their support system.
    6. 25/07/2014 - Installed and set up Microsoft SQL Server 2008 Enterprise Edition
    7. 28/07/2014 - Was able to successfull connect to my local server to create a database in order to import the CSV files
    8. 25/07/2014 - Installed and set up Microsoft SQL Server 2008 Enterprise Edition
    9. 30/07/2014 - Got the corrected data files sent, some had errors in the data
    10. 25/07/2014 to 31/07/2014 - Installed and set up Microsoft SQL Server 2008 Enterprise Edition
      11. Discussed some of the files and what the information the tables contain with Amy - Complaints Administrator.
    11. 05/08/2014 - Meeting: I showed Grace and Amy my implementation and they also compared the output of the data by compairing if we ended up having extactly the same data which was successful.
    12. 05/08/2014 to 06/07/2014 - preparing for the seminar
    13. 06/08/2014 to 10/07/2014 - fixing little things in the implementation, improving it to make it efficient
    14. 06/08/2014 to 14/07/2014 - Writing the mid semester report
    15. 01/09/2014 – 15/09/2014 – Researched tools which are available for reporting such as Tableu, SSRS, Oracle.
    16. 17/09/2014 – 21/09/2014 – Compared and also used SSRS and Tableau to decided which suit was most suitable.
    17. 23/09/2014 – Meeting to discuss issues from SSIS which was in regards to the execution of SSIS and resulting in doubled data in tables. Factors which the Administrator tend to analyse and look at to presentations were discussed.
    18. 23/09/2014-30/09/2014 - Implemented different approaches to issues
    19. 01/10/2014 - 13/10/2014 - Received new data for SSRS. Resolved issues with data and validating to ensure I can move ahead with reporting. Reporting stage started for the factors analysed.
    20. 14/10/2014 - Meeting. Discussed Report facts and metrics, colours, placing, style. Also discussed other complex reporting that can be done which would be useful to uncover in depth inforamtion on products.
    21. 14/10/2014 - 16/10/2014 - Implemented complex reports. Realised Pareto chart can not be used with stacked charts in SSRS.
    22. 16/10/2014 - 19/10/2014 - Worked on appearance and the interactive dashboard.
    23. 20/10/2014 - Meeting to ensure metrics are correct and worked on colour schema and presented everything including interactive dashboard
    24. 20/10/2014 - 21/10/2014 - Anonomyized data and prepared for presentation.
    25. 22/10/2014 - Worked on the final report.

      26. ..