Notes
Notes
3. How is my topic researched and what di erent research methods are there? Technical Research Design
▪ Set of activities needed to realize the objectives set out in the conceptual design phase.
4. Which questions remain unanswered and what has yet to be researched?
▪ Concerns decisions on how, where and when.
Recommendations for your literature search ▪ 3 phases:
1. Concentrate your e orts on the most credible scientific literature. 1. Research Strategy (how)
2. Identify the keywords of your topic and search in academic search engines. 2. Research Material (how)
3. Create a mind map that connects authors/research institutions and areas of knowledge. 3. Research Planning (where/when)
4. If you find a good baseline article, follow their references and where it is referenced.
5. Learn about the strategic areas in your research design Types of Research Objectives
o Research Questions 1. Theory development: This type of research attempts to develop a theory about something
not yet known.
o Research Framework
2. Theory validation: This type of research attempts to find out if a proposed variable
o Definitions and Operationalization
relationship exists by testing existing hypotheses.
Technical Design
Practice oriented research objectives
o Research Strategy
1. Problem Analysis: Recommendations on what technological developments must be made
o Research Material to solve a particular problem.
1. Identify the main issue that will be investigated by describing the key concept that will be the Definitions and operationalization
focus of the work. Get to the details:
▪ Define the content of key concepts with exact definitions.
2. Think of this first in qualitative terms and then try to design the research question that can ▪ Write down which assumptions you are making and why.
link to quantitative evidence. ▪ Describe what you are neglecting and why.
3. Ensure that you at least identify and incorporate what the main drivers (variables that a ect ▪ Indicate what are the indicators/variables that you will use.
research outcome) might be. ▪ Outline how you will measure those indicators/variables.
4. Build towards a main hypothesis that can be tested. The details will allow you to establish the technical research design.
4. The actual units used in your study -> The sample: What/who is in your study? ▪ the greater the SD the greater the error (more variability in sampling distribution).
▪ the greater the sample size the smaller the error (nearing full population).
Convenience sampling
10. Learn about the types of samples
▪ The sample is selected because it is available.
Types of Samples ▪ This needs to be explicitly stated in your research.
▪ It can never be assumed that this sample represents the total population.
Probability Sampling
o Simple random sampling – every element in population is known and has the same Purposive sampling
chance of being selected as a subject.
The sample is selected because we desire the specific information it holds.
o Complex probability sampling – improve e iciency by no longer having every element
Reasons can be:
have the same chance of being selected.
o Expert advice
Non-Probability Sampling
o Quota needed (I need exactly this subjects)
o Convenience sampling – who of the population are available to be sampled.
o Heterogeneity needed
o Purposive sampling – who in the population will hold the desired information.
o Snowball e ect: respondent driven sampling. (one subject leads to another)
Simple Random Sampling This needs to be explicitly stated in your research.
Drawing a sample from a population so that every possible sample has an equal probability of being It can never be assumed that this sample represents the total population.
selected.
Example: From a list of clients draw a random sample.
11. Learn about data sources, types of data and data quality
Complex random sampling
Improve e iciency by no longer having every element have the same chance of being selected. Data sources
Some examples are:
What sources are you going to use?
1. Systematic Random Sampling: Determine randomly where you want to start selecting and o Someone else’s data
then select every nth element in a randomly ordered list. o Theoretical data
o Simulated data
2. Cluster Random Sampling: Dividing population into groups, randomly selecting these
o Experimental data (testing/surveying/observing).
clusters and then sampling each element.
Data rules and regulations
3. Multi-stage Random Sampling: Similar to single stage sampling but reiterating the sampling
method within the sample. Personal Data: We speak of personal data if data can be traced directly or indirectly to a
Example: Select 5 countries within EU to represent the EU, within that select 5 towns, 5 natural person. All personal data are subject to the rules of the General Data Protection
suburbs and 5 villages and within those 2 random ATM machines in order to determine the Regulation (AVG).
bacteria level on EURO notes.
Commercially sensitive data: When you are doing your thesis within a company. Do not
Standard error sign Non-Disclosure Agreements (NDAs) or contracts with companies until you or your
The standard error is the precision of your statistical sample, and it is calculated from the standard supervisor has received legal advice from the university that it is OK to sign.
deviation (SD).
Protected Data: Both the UN and the EU require countries to ensure that knowledge related
Standard deviation: the spread of variability of the scores around their average in a single sample
to nuclear weapons and missile technology is protected.
(square root of the variance).
SD is expressed in the same units as original measure and easy to interpret. Types of Data
In general: Generally, two types can be distinguished:
▪ Qualitative Data – Data collected by means of observation of the environment in which you are ▪ Allow your results to be used in a professional environment.
interested such as text, photos, people. ▪ Allow for academic reproducibility and transparency.
▪ Quantitative Data – Numerical results of measured/simulated variables from wind tunnel data,
Verification and validation in industry
FEM results, surveys.
Verification is a quality control process.
The type of data you generate follows from your research strategy, research material and your
▪ Used to evaluate whether a product, service, or system complies with regulations,
defined variables.
specifications, or conditions imposed at the start of a development phase.
Sometimes, you will want to convert qualitative data in quantitative or vice versa.
▪ Verification can be in development, scale-up, or production.
Data quality ▪ Often an internal process.
Before starting to analyze you must ensure data is of su icient quality:
Validation is a quality assurance process.
▪ Check for typing errors.
▪ Establishing evidence that provides a high degree of assurance that a product, service, or
▪ Check for outliers.
system accomplishes its intended requirements.
▪ Check for errors in coding your data.
▪ Often involves acceptance of fitness for purpose with end users and other product
▪ Check if data meets expectations.
stakeholders.
Some recommendations: ▪ Often an external process.
▪ Keep a good research logbook of what you do.
Verification and validation in your research
▪ Have a data management plan.
1. Observation & Formation of the topic
Research Logbook
Document where you document: 2. Hypothesis
▪ Choices you made in your research design.
3. Conceptual Design
▪ Assumptions you made.
▪ How you carried out your experiments. 4. Technical Design
▪ Any incidents during your experiments.
5. Data Gathering
▪ Where you have stored pictures & footage & relevant files.
▪ File names and changes per file. 6. Data Analysis
▪ People you talked to (including your meetings with your supervisors).
7. Data Interpretation
The more detailed your logbook is, the easier your thesis writing will be.
8. Validation & Verification, Revision of hypothesis
IV. Legal and ethical requirements 4. E ective Communication: It facilitates transparent communication with the supervisory
▪ Will you work with any other types of confidential or classified data? team. This makes sure that the challenges of the project are clearly shared.
▪ Does your research involve human subjects or 3rd party datasets collected from human
Estimating your tasks
participants?
The first step in project management is to make estimates about the steps needed to complete the
V. DATA SHARING AND LONG-TERM PRESERVATION project.
▪ What data will be publicly shared? To accomplish that we first outline all the tasks needed and then estimate how long each task might
▪ How will you share your research data (and code)? take.
Manage & Share | [Link]
There are three main estimating methods that can be used:
▪ Under what license will be the data/code released?
▪ Comparative estimating
▪ CC0 (No Rights Reserved, Public Domain)
▪ Parametric estimating
▪ CC-BY (Attribution)
▪ Bottom-up estimating
▪ CC BY-SA (Attribution-ShareAlike)
▪ CC BY-NC (Attribution-NonCommercial) Work Breakdown Structure (WBS)
▪ A Work Breakdown Structure visually divides the master thesis project into tasks, breaking down
VI. DATA MANAGEMENT RESPONSIBILITIES
the research into smaller, more easily manageable pieces.
▪ Is TU Delft the lead institution for this project?
▪ The WBS usually is divided in work packages, tasks and (maybe) sub-tasks.
▪ The preparation of a WBS for the project must be done down to a level of detail that allows for an Software guides
estimation of the time required per task.
ACADEMIA
▪ The individual estimates are then summed to give the total estimate for the project.
Assignments
Resource Management
▪ In project management terms, resources are the people, equipment, facilities or any other entity (Master / PhD/ ...) thesis
that is needed to complete an activity.
Conference articles
▪ Some resources are re-usable (such as people), and others are consumable (such as a plate of
aluminum alloy). Journal articles
▪ Most resources are not always available and require tasks to be performed to have access to
The goal is to communicate information needed to UNDERSTAND A SUBJECT or to CARRY OUT A
them.
TASK.
▪ To understand the complete picture, the resource or resources required to work on each task must
be described and their availability (or lack thereof) known. What to write in a Technical Report?
A technical report conveys SPECIFIC INFORMATION about a TECHNICAL SUBJECT to a SPECIFIC
Project Planning
AUDIENCE for a SPECIFIC and PRACTICAL PURPOSE.
▪ Project Planning is the time-based articulation of the overall project plan.
▪ A proper schedule can only be put together when all conceptual and technical research design has What to write in the Research Methodologies Report?
been outlined. A technical report conveys your RESEARCH PLAN about YOUR RESEARCH TOPIC to a TECHNICAL
▪ Putting together a plan allows you to predict the overall project duration and when activities and PERSON FAMILIAR WITH YOUR FIELD with the purpose of ORGANISING YOUR RESEARCH
events are planned to happen. ACTIVITIES.
▪ The most common way of showing a project’s plan is to use a Gantt chart.
Any Report Structure
▪ A Gantt chart allows you to detect the critical path or paths for the project. A critical path will
determine the shortest time in which a project can be completed. HEAD = INTRODUCTION: It helps the reader understand the report but it has to be
proportional to the main body.
MAIN BODY: Divided into sections but they have to be connected to each other in a nice
16. Learn why write a Technical Report & Learn what to write in a Technical Report
flow.
Why write Technical Reports?
FEET = CONCLUSIONS: The whole report stands on them. No new information here.
“Everybody hates to write them,
Everybody hates to read them, Research Methodologies Report Structure
Almost nobody reads them,
HEAD = INTRODUCTION: It helps the reader understand the importance of your research.
They take a huge amount of time to write,
Why is it important to study this?
They are absolutely crucial to your success in engineering!”
MAIN BODY: Describes your research plan.
Because you have to: Communicating your work is not something to add to your job, it is part of
your job! o Research questions
Project handover documentation FEET = CONCLUSIONS: Describes concisely all the aspects of your report. If you just read
the conclusions, you get a good idea of your plan.
Instruction manuals
When to write? Some recommendations Numbered style e.g.: AIAA style
Write little and often, avoid binge writing, embrace snack writing. Citation in the document:
Writing clarifies your thinking. o Parenthetical citation: E.g.: The most important parameter to scale a sandwich
composite shell is the ratio between the radius and the equivalent thickness of the
If you usually: “think – think – think” and then “write – write – write”.
sandwich structure [1].
Try instead: “think – write – think – write – think – write”.
o Narrative citation: E.g.: Uriol Balbin et al. [1] demonstrated that the most important
Set specific times to write.
parameter to scale a shell is the ratio between the Radius and the equivalent
Set specific places to write. thickness of the sandwich structure.
Reference list: References ordered numerically, in the order in which they appear in the text.
[1] Uriol Balbin, I., Bisagni, C., Schultz, M. R., and Hilburger, M. W. "Scaling Methodology
17. Check that your reference list is correct
Applied to Buckling of Sandwich Composite Cylindrical Shells," AIAA Journal Vol. 58, No. 8,
Some suggestions 2020, pp. 3680-3689.
▪ Use at least 3 di erent document types.
Advantage: A reader who wants to check all references while reading a paper, can easily move from
▪ Use at least one book (Usually this is used for theory background).
one reference to the next without having to search for the next author’s name in a (long) list.
▪ Use at most two websites (or no more than 10% of the literature list).
Disadvantage: In-text references do not contain any useful information themselves.
▪ Include patents, standards, technical documents etc.
▪ Most of your sources should be peer-reviewed journal articles. Final Reference Checklist
▪ Check the topicality of the information: Most sources must be less than 10 years old.
All illustrations, that are not your own, are referenced.
Choose one reference style and stick to it!
All statements, that are not your own, are substantiated with references. (Where did you find
Author-date style e.g.: APA style the information?)
Citation in the document: Direct citations are put in quotation marks; paraphrases are written in your own words.
o Parenthetical citation: E.g.: The most important parameter to scale a sandwich Each citation or paraphrase includes a correct in-text reference according to the rules of the
composite shell is the ratio between the radius and the equivalent thickness of the chosen reference style.
sandwich structure (Uriol Balbin et al., 2020).
All references are correct and complete, according to the rules of the chosen reference style.
o Narrative citation: E.g.: Uriol Balbin et al. (2020) demonstrated that the most
The literature list contains all references used in the text.
important parameter to scale a shell is the ratio between the radius and the
equivalent thickness of the sandwich structure. The literature list contains only references used in the text.
Step 2: GUIDE THEM IN: The nomenclature is consistent throughout the report.
The reader does not know your work. You want the report to attract and maintain readers’ attention.
All acronyms are defined the first time they are mentioned.
Readers first look at the titles, then at the pictures, then at the conclusions, and then to the rest of
the report. All figures are readable in pdf format.
▪ The layout must look nice (right placement, high resolution images).
All figures and tables include a caption.
▪ Images and block diagrams help convey information much more than detailed explanations.
▪ Images, tables and graphs must be clear and self-explanatory. Figures are clear (units, axes labels, legend …) without reading the text.
How to write: 4Cs style principles The title captures the contents of the report.
CLEAR: Easily understood by the intended audience. The introduction captures the attention of the ideal reader to the report.
COMPREHENSIVE: All the necessary information is present. Conclusions are understood without reading the rest of the report.
Improve or generate text: sometimes it is too redundant (overwriting), you might need to
edit it out!
Generate ideas or brainstorm: might provide good ideas but remember that it can only look
back in time!