handouts/ho01.tex
author Christian Urban <christian dot urban at kcl dot ac dot uk>
Wed, 30 Mar 2016 15:02:21 +0100
changeset 453 5921eebd9add
parent 450 f3d5e57ca00a
child 455 2d9e005100f4
permissions -rw-r--r--
updated
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
     1
\documentclass{article}
158
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
     2
\usepackage{../style}
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
     3
\usepackage{../langs}
158
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
     4
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
     5
\lstset{language=JavaScript}
158
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
     6
366
34a8f73b2c94 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 365
diff changeset
     7
158
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
     8
\begin{document}
446
64c20ed7941a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 445
diff changeset
     9
\fnote{\copyright{} Christian Urban, 
64c20ed7941a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 445
diff changeset
    10
King's College London, 2014, 2015, 2016}
158
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    11
431
4b53f83c070c updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 383
diff changeset
    12
%Ross anderson
4b53f83c070c updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 383
diff changeset
    13
%https://youtu.be/FY2YKxBxOkg
453
5921eebd9add updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 450
diff changeset
    14
%http://www.scmagazineuk.com/amazon-launches-open-source-tls-implementation-s2n/article/424360/
431
4b53f83c070c updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 383
diff changeset
    15
167
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 160
diff changeset
    16
\section*{Handout 1 (Security Engineering)}
158
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    17
366
34a8f73b2c94 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 365
diff changeset
    18
158
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    19
Much of the material and inspiration in this module is taken
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    20
from the works of Bruce Schneier, Ross Anderson and Alex
159
77cf0362b87a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 158
diff changeset
    21
Halderman. I think they are the world experts in the area of
77cf0362b87a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 158
diff changeset
    22
security engineering. I especially like that they argue that a
77cf0362b87a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 158
diff changeset
    23
security engineer requires a certain \emph{security mindset}.
77cf0362b87a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 158
diff changeset
    24
Bruce Schneier for example writes:
158
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    25
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    26
\begin{quote} 
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    27
\it ``Security engineers --- at least the good ones --- see
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    28
the world differently. They can't walk into a store without
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    29
noticing how they might shoplift. They can't use a computer
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    30
without wondering about the security vulnerabilities. They
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    31
can't vote without trying to figure out how to vote twice.
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    32
They just can't help it.''
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    33
\end{quote}
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    34
443
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
    35
\noindent
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
    36
and
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
    37
158
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    38
\begin{quote}
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    39
\it ``Security engineering\ldots requires you to think
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    40
differently. You need to figure out not how something works,
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    41
but how something can be made to not work. You have to imagine
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    42
an intelligent and malicious adversary inside your system
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    43
\ldots, constantly trying new ways to
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    44
subvert it. You have to consider all the ways your system can
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    45
fail, most of them having nothing to do with the design
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    46
itself. You have to look at everything backwards, upside down,
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    47
and sideways. You have to think like an alien.''
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    48
\end{quote}
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    49
159
77cf0362b87a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 158
diff changeset
    50
\noindent In this module I like to teach you this security
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
    51
mindset. This might be a mindset that you think is very
446
64c20ed7941a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 445
diff changeset
    52
foreign to you---after all we are all good citizens and do not
443
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
    53
hack into things. However, I beg to differ: You have this
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
    54
mindset already when in school you were thinking, at least
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
    55
hypothetically, about ways in which you can cheat in an exam
227
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
    56
(whether it is by hiding notes or by looking over the
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
    57
shoulders of your fellow pupils). Right? To defend a system,
443
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
    58
you need to have this kind of mindset and be able to think
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
    59
like an attacker. This will include understanding techniques
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
    60
that can be used to compromise security and privacy in
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
    61
systems. This will many times result in insights where
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
    62
well-intended security mechanisms made a system actually less
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
    63
secure.\medskip
158
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    64
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
    65
\noindent 
159
77cf0362b87a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 158
diff changeset
    66
{\Large\bf Warning!} However, don’t be evil! Using those
77cf0362b87a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 158
diff changeset
    67
techniques in the real world may violate the law or King’s
77cf0362b87a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 158
diff changeset
    68
rules, and it may be unethical. Under some circumstances, even
77cf0362b87a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 158
diff changeset
    69
probing for weaknesses of a system may result in severe
160
4cbd6ca025e6 updated slides
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 159
diff changeset
    70
penalties, up to and including expulsion, fines and
159
77cf0362b87a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 158
diff changeset
    71
jail time. Acting lawfully and ethically is your
77cf0362b87a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 158
diff changeset
    72
responsibility. Ethics requires you to refrain from doing
77cf0362b87a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 158
diff changeset
    73
harm. Always respect privacy and rights of others. Do not
77cf0362b87a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 158
diff changeset
    74
tamper with any of King's systems. If you try out a technique,
77cf0362b87a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 158
diff changeset
    75
always make doubly sure you are working in a safe environment
160
4cbd6ca025e6 updated slides
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 159
diff changeset
    76
so that you cannot cause any harm, not even accidentally.
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
    77
Don't be evil. Be an ethical hacker.\medskip
158
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    78
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
    79
\noindent In this lecture I want to make you familiar with the
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
    80
security mindset and dispel the myth that encryption is the
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
    81
answer to all security problems (it is certainly often a part
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
    82
of an answer, but almost always never a sufficient one). This
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
    83
is actually an important thread going through the whole
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
    84
course: We will assume that encryption works perfectly, but
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
    85
still attack ``things''. By ``works perfectly'' we mean that
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
    86
we will assume encryption is a black box and, for example,
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
    87
will not look at the underlying mathematics and break the
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
    88
algorithms.\footnote{Though fascinating this might be.}
158
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
    89
 
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
    90
For a secure system, it seems, four requirements need to come
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
    91
together: First a security policy (what is supposed to be
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
    92
achieved?); second a mechanism (cipher, access controls,
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
    93
tamper resistance etc); third the assurance we obtain from the
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
    94
mechanism (the amount of reliance we can put on the mechanism)
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
    95
and finally the incentives (the motive that the people
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
    96
guarding and maintaining the system have to do their job
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
    97
properly, and also the motive that the attackers have to try
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
    98
to defeat your policy). The last point is often overlooked,
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
    99
but plays an important role. To illustrate this lets look at
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   100
an example. 
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   101
446
64c20ed7941a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 445
diff changeset
   102
\subsubsection*{Chip-and-PIN is Surely More Secure, No?}
180
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   103
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   104
The questions is whether the Chip-and-PIN system used with
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   105
modern credit cards is more secure than the older method of
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   106
signing receipts at the till. On first glance the answer seems
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   107
obvious: Chip-and-PIN must be more secure and indeed improved
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   108
security was the central plank in the ``marketing speak'' of
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   109
the banks behind Chip-and-PIN. The earlier system was based on
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   110
a magnetic stripe or a mechanical imprint on the cards and
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   111
required customers to sign receipts at the till whenever they
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   112
bought something. This signature authorised the transactions.
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   113
Although in use for a long time, this system had some crucial
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   114
security flaws, including making clones of credit cards and
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   115
forging signatures. 
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   116
177
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   117
Chip-and-PIN, as the name suggests, relies on data being
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   118
stored on a chip on the card and a PIN number for
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   119
authorisation. Even though the banks involved trumpeted their
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   120
system as being absolutely secure and indeed fraud rates
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   121
initially went down, security researchers were not convinced
450
f3d5e57ca00a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 446
diff changeset
   122
(especially not the group around Ross
f3d5e57ca00a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 446
diff changeset
   123
Anderson).\footnote{Actually, historical data about fraud
f3d5e57ca00a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 446
diff changeset
   124
showed that first fraud rates went up (while early problems to
f3d5e57ca00a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 446
diff changeset
   125
do with the introduction of Chip-and-PIN we exploited), then
f3d5e57ca00a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 446
diff changeset
   126
down, but recently up again (because criminals getting more
f3d5e57ca00a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 446
diff changeset
   127
familiar with the technology and how it can be exloited).} To begin with, the
f3d5e57ca00a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 446
diff changeset
   128
Chip-and-PIN system introduced a ``new player'' into the
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   129
system that needed to be trusted: the PIN terminals and their
180
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   130
manufacturers. It was claimed that these terminals were
177
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   131
tamper-resistant, but needless to say this was a weak link in
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   132
the system, which criminals successfully attacked. Some
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   133
terminals were even so skilfully manipulated that they
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   134
transmitted skimmed PIN numbers via built-in mobile phone
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   135
connections. To mitigate this flaw in the security of
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   136
Chip-and-PIN, you need to be able to vet quite closely the
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   137
supply chain of such terminals. This is something that is
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   138
mostly beyond the control of customers who need to use these
446
64c20ed7941a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 445
diff changeset
   139
terminals. 
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   140
227
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   141
To make matters worse for Chip-and-PIN, around 2009 Ross
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   142
Anderson and his group were able to perform man-in-the-middle
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   143
attacks against Chip-and-PIN. Essentially they made the
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   144
terminal think the correct PIN was entered and the card think
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   145
that a signature was used. This is a kind of \emph{protocol
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   146
failure}. After discovery, the flaw was mitigated by requiring
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   147
that a link between the card and the bank is established at
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   148
every time the card is used. Even later this group found
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   149
another problem with Chip-and-PIN and ATMs which did not
383
3e1a2c8ed980 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 381
diff changeset
   150
generate random enough numbers (cryptographic nonces) on which
3e1a2c8ed980 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 381
diff changeset
   151
the security of the underlying protocols relies. 
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   152
381
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   153
The overarching problem with all this is that the banks who
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   154
introduced Chip-and-PIN managed with the new system to shift
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   155
the liability for any fraud and the burden of proof onto the
177
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   156
customer. In the old system, the banks had to prove that the
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   157
customer used the card, which they often did not bother with.
381
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   158
In effect, if fraud occurred the customers were either
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   159
refunded fully or lost only a small amount of money. This
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   160
taking-responsibility-of-potential-fraud was part of the
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   161
``business plan'' of the banks and did not reduce their
177
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   162
profits too much. 
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   163
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   164
Since banks managed to successfully claim that their
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   165
Chip-and-PIN system is secure, they were under the new system
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   166
able to point the finger at the customer when fraud occurred:
227
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   167
customers must have been negligent losing their PIN and
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   168
customers had almost no way of defending themselves in such
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   169
situations. That is why the work of \emph{ethical} hackers
446
64c20ed7941a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 445
diff changeset
   170
like Ross Anderson's group is so important, because they and
227
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   171
others established that the banks' claim that their system is
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   172
secure and it must have been the customer's fault, was bogus.
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   173
In 2009 the law changed and the burden of proof went back to
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   174
the banks. They need to prove whether it was really the
443
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   175
customer who used a card or not. The current state of affairs,
446
64c20ed7941a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 445
diff changeset
   176
however, is that standing up for your right requires you to be
64c20ed7941a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 445
diff changeset
   177
knowledgeable, potentially having to go to court\ldots{}if
64c20ed7941a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 445
diff changeset
   178
not, the banks are happy to take advantage of you.
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   179
177
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   180
This is a classic example where a security design principle
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   181
was violated: Namely, the one who is in the position to
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   182
improve security, also needs to bear the financial losses if
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   183
things go wrong. Otherwise, you end up with an insecure
46e581d66f3a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 176
diff changeset
   184
system. In case of the Chip-and-PIN system, no good security
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   185
engineer would dare to claim that it is secure beyond
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   186
reproach: the specification of the EMV protocol (underlying
180
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   187
Chip-and-PIN) is some 700 pages long, but still leaves out
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   188
many things (like how to implement a good random number
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   189
generator). No human being is able to scrutinise such a
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   190
specification and ensure it contains no flaws. Moreover, banks
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   191
can add their own sub-protocols to EMV. With all the
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   192
experience we already have, it is as clear as day that
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   193
criminals were bound to eventually be able to poke holes into
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   194
it and measures need to be taken to address them. However,
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   195
with how the system was set up, the banks had no real
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   196
incentive to come up with a system that is really secure.
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   197
Getting the incentives right in favour of security is often a
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   198
tricky business. From a customer point of view, the
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   199
Chip-and-PIN system was much less secure than the old
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   200
signature-based method. The customer could now lose
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   201
significant amounts of money.
173
9126c13a7d93 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 169
diff changeset
   202
445
9ad6445a0354 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 443
diff changeset
   203
If you want to watch an entertaining talk about attacking
9ad6445a0354 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 443
diff changeset
   204
Chip-and-PIN cards, then this talk from the 2014 Chaos
9ad6445a0354 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 443
diff changeset
   205
Computer Club conference is for you:
9ad6445a0354 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 443
diff changeset
   206
9ad6445a0354 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 443
diff changeset
   207
\begin{center}
9ad6445a0354 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 443
diff changeset
   208
\url{https://www.youtube.com/watch?v=XeZbVZQsKO8}
9ad6445a0354 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 443
diff changeset
   209
\end{center}
9ad6445a0354 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 443
diff changeset
   210
446
64c20ed7941a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 445
diff changeset
   211
\noindent They claim that they are able to clone Chip-and-PINs
64c20ed7941a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 445
diff changeset
   212
cards such that they get all data that was on the Magstripe,
64c20ed7941a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 445
diff changeset
   213
except for three digits (the CVV number). Remember,
64c20ed7941a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 445
diff changeset
   214
Chip-and-PIN cards were introduced exactly for preventing
450
f3d5e57ca00a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 446
diff changeset
   215
this. Ross Anderson also talked about his research at the
f3d5e57ca00a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 446
diff changeset
   216
BlackHat Conference in 2014:
445
9ad6445a0354 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 443
diff changeset
   217
450
f3d5e57ca00a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 446
diff changeset
   218
\begin{center}
f3d5e57ca00a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 446
diff changeset
   219
\url{https://www.youtube.com/watch?v=ET0MFkRorbo}
f3d5e57ca00a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 446
diff changeset
   220
\end{center}
445
9ad6445a0354 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 443
diff changeset
   221
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   222
\subsection*{Of Cookies and Salts}
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   223
355
619073c37649 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 336
diff changeset
   224
Let us look at another example which will help with understanding how
619073c37649 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 336
diff changeset
   225
passwords should be verified and stored.  Imagine you need to develop
619073c37649 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 336
diff changeset
   226
a web-application that has the feature of recording how many times a
619073c37649 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 336
diff changeset
   227
customer visits a page.  For example in order to give a discount
619073c37649 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 336
diff changeset
   228
whenever the customer has visited a webpage some $x$ number of times
381
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   229
(say $x$ equals $5$). There is one more constraint: we want to store
355
619073c37649 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 336
diff changeset
   230
the information about the number of visits as a cookie on the
619073c37649 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 336
diff changeset
   231
browser. I think, for a number of years the webpage of the New York
619073c37649 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 336
diff changeset
   232
Times operated in this way: it allowed you to read ten articles per
619073c37649 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 336
diff changeset
   233
month for free; if you wanted to read more, you had to pay. My best
619073c37649 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 336
diff changeset
   234
guess is that it used cookies for recording how many times their pages
619073c37649 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 336
diff changeset
   235
was visited, because if I switched browsers I could easily circumvent
619073c37649 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 336
diff changeset
   236
the restriction about ten articles.\footnote{Another online media that
619073c37649 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 336
diff changeset
   237
  works in this way is the Times Higher Education
381
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   238
  \url{http://www.timeshighereducation.co.uk}. It also seems to 
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   239
  use cookies to restrict the number of free articles to five.}
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   240
178
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   241
To implement our web-application it is good to look under the
180
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   242
hood what happens when a webpage is displayed in a browser. A
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   243
typical web-application works as follows: The browser sends a
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   244
GET request for a particular page to a server. The server
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   245
answers this request with a webpage in HTML (for our purposes
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   246
we can ignore the details about HTML). A simple JavaScript
325
48c6751f2173 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 312
diff changeset
   247
program that realises a server answering with a ``Hello
48c6751f2173 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 312
diff changeset
   248
World'' webpage is as follows:
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   249
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   250
\begin{center}
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   251
\lstinputlisting{../progs/ap0.js}
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   252
\end{center}
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   253
178
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   254
\noindent The interesting lines are 4 to 7 where the answer to
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   255
the GET request is generated\ldots in this case it is just a
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   256
simple string. This program is run on the server and will be
180
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   257
executed whenever a browser initiates such a GET request. You
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   258
can run this program on your computer and then direct a
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   259
browser to the address \pcode{localhost:8000} in order to
443
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   260
simulate a request over the internet. You are encouraged
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   261
to try this out\ldots{}theory is always good, but practice is 
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   262
better.
180
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   263
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   264
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   265
For our web-application of interest is the feature that the
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   266
server when answering the request can store some information
180
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   267
on the client's side. This information is called a
178
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   268
\emph{cookie}. The next time the browser makes another GET
180
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   269
request to the same webpage, this cookie can be read again by
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   270
the server. We can use cookies in order to store a counter
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   271
that records the number of times our webpage has been visited.
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   272
This can be realised with the following small program
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   273
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   274
\begin{center}
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   275
\lstinputlisting{../progs/ap2.js}
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   276
\end{center}
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   277
178
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   278
\noindent The overall structure of this program is the same as
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   279
the earlier one: Lines 7 to 17 generate the answer to a
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   280
GET-request. The new part is in Line 8 where we read the
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   281
cookie called \pcode{counter}. If present, this cookie will be
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   282
send together with the GET-request from the client. The value
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   283
of this counter will come in form of a string, therefore we
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   284
use the function \pcode{parseInt} in order to transform it
178
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   285
into an integer. In case the cookie is not present, we default
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   286
the counter to zero. The odd looking construction \code{...||
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   287
0} is realising this defaulting in JavaScript. In Line 9 we
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   288
increase the counter by one and store it back to the client
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   289
(under the name \pcode{counter}, since potentially more than
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   290
one value could be stored). In Lines 10 to 15 we test whether
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   291
this counter is greater or equal than 5 and send accordingly a
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   292
specially grafted message back to the client.
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   293
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   294
Let us step back and analyse this program from a security
178
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   295
point of view. We store a counter in plain text on the
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   296
client's browser (which is not under our control). Depending
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   297
on this value we want to unlock a resource (like a discount)
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   298
when it reaches a threshold. If the client deletes the cookie,
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   299
then the counter will just be reset to zero. This does not
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   300
bother us, because the purported discount will just not be
180
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   301
granted. In this way we do not lose any (hypothetical) money.
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   302
What we need to be concerned about is, however, when a client
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   303
artificially increases this counter without having visited our
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   304
web-page. This is actually a trivial task for a knowledgeable
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   305
person, since there are convenient tools that allow one to set
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   306
a cookie to an arbitrary value, for example above our
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   307
threshold for the discount. 
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   308
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   309
There seems to be no simple way to prevent this kind of
178
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   310
tampering with cookies, because the whole purpose of cookies
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   311
is that they are stored on the client's side, which from the
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   312
the server's perspective is a potentially hostile environment.
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   313
What we need to ensure is the integrity of this counter in
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   314
this hostile environment. We could think of encrypting the
227
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   315
counter. But this has two drawbacks to do with the keys for
178
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   316
encryption. If you use a single, global key for all the
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   317
clients that visit our site, then we risk that our whole
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   318
``business'' might collapse in the event this key gets known
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   319
to the outside world. Then all cookies we might have set in
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   320
the past, can now be decrypted and manipulated. If, on the
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   321
other hand, we use many ``private'' keys for the clients, then
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   322
we have to solve the problem of having to securely store this
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   323
key on our server side (obviously we cannot store the key with
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   324
the client because then the client again has all data to
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   325
tamper with the counter; and obviously we also cannot encrypt
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   326
the key, lest we can solve an impossible chicken-and-egg
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   327
problem). So encryption seems to not solve the problem we face
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   328
with the integrity of our counter.
169
2866fae8c1cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 168
diff changeset
   329
336
3cb200fa6d6a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 325
diff changeset
   330
Fortunately, \emph{cryptographic hash functions} seem to be
3cb200fa6d6a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 325
diff changeset
   331
more suitable for our purpose. Like encryption, hash functions
3cb200fa6d6a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 325
diff changeset
   332
scramble data in such a way that it is easy to calculate the
3cb200fa6d6a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 325
diff changeset
   333
output of a hash function from the input. But it is hard
3cb200fa6d6a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 325
diff changeset
   334
(i.e.~practically impossible) to calculate the input from
3cb200fa6d6a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 325
diff changeset
   335
knowing the output. This is often called \emph{preimage
3cb200fa6d6a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 325
diff changeset
   336
resistance}. Cryptographic hash functions also ensure that
3cb200fa6d6a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 325
diff changeset
   337
given a message and a hash, it is computationally infeasible to
3cb200fa6d6a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 325
diff changeset
   338
find another message with the same hash. This is called
443
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   339
\emph{collusion resistance}. Because of these properties, hash
383
3e1a2c8ed980 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 381
diff changeset
   340
functions are often called \emph{one-way functions}: you
336
3cb200fa6d6a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 325
diff changeset
   341
cannot go back from the output to the input (without some
3cb200fa6d6a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 325
diff changeset
   342
tricks, see below). 
3cb200fa6d6a updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 325
diff changeset
   343
443
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   344
There are several such hashing function. For example SHA-1
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   345
would hash the string \pcode{"hello world"} to produce the
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   346
hash-value
175
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   347
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   348
\begin{center}
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   349
\pcode{2aae6c35c94fcfb415dbe95f408b9ce91ee846ed}
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   350
\end{center}
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   351
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   352
\noindent Another handy feature of hash functions is that if
178
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   353
the input changes only a little, the output changes
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   354
drastically. For example \pcode{"iello world"} produces under
175
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   355
SHA-1 the output
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   356
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   357
\begin{center}
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   358
\pcode{d2b1402d84e8bcef5ae18f828e43e7065b841ff1}
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   359
\end{center}
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   360
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   361
\noindent That means it is not predictable what the output
178
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   362
will be from just looking at input that is ``close by''. 
175
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   363
178
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   364
We can use hashes in our web-application and store in the
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   365
cookie the value of the counter in plain text but together
180
a95782c2f046 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 179
diff changeset
   366
with its hash. We need to store both pieces of data in such a
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   367
way that we can extract them again later on. In the code below
383
3e1a2c8ed980 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 381
diff changeset
   368
I will just separate them using a \pcode{"-"}. For the
3e1a2c8ed980 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 381
diff changeset
   369
counter \pcode{1} for example
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   370
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   371
\begin{center}
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   372
\pcode{1-356a192b7913b04c54574d18c28d46e6395428ab}
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   373
\end{center}
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   374
443
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   375
\noindent If we now read back the cookie when the client
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   376
visits our webpage, we can extract the counter, hash it again
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   377
and compare the result to the stored hash value inside the
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   378
cookie. If these hashes disagree, then we can deduce that the
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   379
cookie has been tampered with. Unfortunately, if they agree,
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   380
we can still not be entirely sure that not a clever hacker has
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   381
tampered with the cookie. The reason is that the hacker can
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   382
see the clear text part of the cookie, say \pcode{3}, and also
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   383
its hash. It does not take much trial and error to find out
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   384
that we used the SHA-1 hashing function and then the hacker
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   385
can graft a cookie accordingly. This is eased by the fact that
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   386
for SHA-1 many strings and corresponding hash-values are
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   387
precalculated. Type, for example, into Google the hash value
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   388
for \pcode{"hello world"} and you will actually pretty quickly
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   389
find that it was generated by input string \pcode{"hello
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   390
world"}. Similarly for the hash-value for \pcode{1}. This
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   391
defeats the purpose of a hashing function and thus would not
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   392
help us with our web-applications and later also not with how
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   393
to store passwords properly. 
175
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   394
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   395
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   396
There is one ingredient missing, which happens to be called
178
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   397
\emph{salts}. Salts are random keys, which are added to the
181
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   398
counter before the hash is calculated. In our case we must
178
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   399
keep the salt secret. As can be see in Figure~\ref{hashsalt},
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   400
we need to extract from the cookie the counter value and its
181
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   401
hash (Lines 19 and 20). But before hashing the counter again
178
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   402
(Line 22) we need to add the secret salt. Similarly, when we
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   403
set the new increased counter, we will need to add the salt
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   404
before hashing (this is done in Line 15). Our web-application
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   405
will now store cookies like 
175
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   406
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   407
\begin{figure}[p]
178
13c6bd6e3477 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 177
diff changeset
   408
\lstinputlisting{../progs/App4.js}
365
942205605c30 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 358
diff changeset
   409
\caption{A Node.js web-app that sets a cookie in the client's
942205605c30 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 358
diff changeset
   410
browser for counting the number of visits to a page.\label{hashsalt}}
175
4ebc97e6fdf0 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 174
diff changeset
   411
\end{figure}
169
2866fae8c1cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 168
diff changeset
   412
179
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   413
\begin{center}\tt
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   414
\begin{tabular}{l}
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   415
1 + salt - 8189effef4d4f7411f4153b13ff72546dd682c69\\
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   416
2 + salt - 1528375d5ceb7d71597053e6877cc570067a738f\\
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   417
3 + salt - d646e213d4f87e3971d9dd6d9f435840eb6a1c06\\
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   418
4 + salt - 5b9e85269e4461de0238a6bf463ed3f25778cbba\\
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   419
...\\
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   420
\end{tabular}
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   421
\end{center}
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   422
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   423
\noindent These hashes allow us to read and set the value of
181
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   424
the counter, and also give us confidence that the counter has
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   425
not been tampered with. This of course depends on being able
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   426
to keep the salt secret. Once the salt is public, we better
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   427
ignore all cookies and start setting them again with a new
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   428
salt.
179
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   429
181
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   430
There is an interesting and very subtle point to note with
383
3e1a2c8ed980 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 381
diff changeset
   431
respect to the 'New York Times' way of checking the number
181
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   432
visits. Essentially they have their `resource' unlocked at the
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   433
beginning and lock it only when the data in the cookie states
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   434
that the allowed free number of visits are up. As said before,
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   435
this can be easily circumvented by just deleting the cookie or
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   436
by switching the browser. This would mean the New York Times
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   437
will lose revenue whenever this kind of tampering occurs. The
443
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   438
`quick fix' to require that a cookie must always be present
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   439
does not work, because then this newspaper will cut off any
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   440
new readers, or anyone who gets a new computer. In contrast,
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   441
our web-application has the resource (discount) locked at the
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   442
beginning and only unlocks it if the cookie data says so. If
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   443
the cookie is deleted, well then the resource just does not
383
3e1a2c8ed980 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 381
diff changeset
   444
get unlocked. No major harm will result to us. You can see:
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   445
the same security mechanism behaves rather differently
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   446
depending on whether the ``resource'' needs to be locked or
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   447
unlocked. Apart from thinking about the difference very
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   448
carefully, I do not know of any good ``theory'' that could
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   449
help with solving such security intricacies in any other way.  
179
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   450
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   451
\subsection*{How to Store Passwords Properly?}
179
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   452
181
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   453
While admittedly quite silly, the simple web-application in
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   454
the previous section should help with the more important
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   455
question of how passwords should be verified and stored. It is
179
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   456
unbelievable that nowadays systems still do this with
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   457
passwords in plain text. The idea behind such plain-text
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   458
passwords is of course that if the user typed in
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   459
\pcode{foobar} as password, we need to verify whether it
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   460
matches with the password that is already stored for this user
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   461
in the system. Why not doing this with plain-text passwords?
227
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   462
Unfortunately doing this verification in plain text is really
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   463
a bad idea. Alas, evidence suggests it is still a
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   464
widespread practice. I leave you to think about why verifying
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   465
passwords in plain text is a bad idea.
181
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   466
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   467
Using hash functions, like in our web-application, we can do
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   468
better. They allow us to not having to store passwords in
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   469
plain text for verification whether a password matches or not.
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   470
We can just hash the password and store the hash-value. And
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   471
whenever the user types in a new password, well then we hash
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   472
it again and check whether the hash-values agree. Just like
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   473
in the web-application before.
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   474
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   475
Lets analyse what happens when a hacker gets hold of such a
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   476
hashed password database. That is the scenario we want to
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   477
defend against.\footnote{If we could assume our servers can
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   478
never be broken into, then storing passwords in plain text
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   479
would be no problem. The point, however, is that servers are
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   480
never absolutely secure.} The hacker has then a list of user names and
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   481
associated hash-values, like 
181
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   482
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   483
\begin{center}
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   484
\pcode{urbanc:2aae6c35c94fcfb415dbe95f408b9ce91ee846ed}
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   485
\end{center}
179
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   486
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   487
\noindent For a beginner-level hacker this information is of
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   488
no use. It would not work to type in the hash value instead of
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   489
the password, because it will go through the hashing function
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   490
again and then the resulting two hash-values will not match.
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   491
One attack a hacker can try, however, is called a \emph{brute
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   492
force attack}. Essentially this means trying out exhaustively
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   493
all strings
181
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   494
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   495
\begin{center}
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   496
\pcode{a},
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   497
\pcode{aa},
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   498
\pcode{...},
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   499
\pcode{ba},
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   500
\pcode{...},
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   501
\pcode{zzz},
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   502
\pcode{...}
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   503
\end{center}   
a736a0c324a3 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 180
diff changeset
   504
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   505
\noindent and so on, hash them and check whether they match
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   506
with the hash-values in the database. Such brute force attacks
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   507
are surprisingly effective. With modern technology (usually
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   508
GPU graphic cards), passwords of moderate length only need
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   509
seconds or hours to be cracked. Well, the only defence we have
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   510
against such brute force attacks is to make passwords longer
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   511
and force users to use the whole spectrum of letters and keys
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   512
for passwords. The hope is that this makes the search space
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   513
too big for an effective brute force attack.
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   514
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   515
Unfortunately, clever hackers have another ace up their
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   516
sleeves. These are called \emph{dictionary attacks}. The idea
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   517
behind dictionary attack is the observation that only few
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   518
people are competent enough to use sufficiently strong
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   519
passwords. Most users (at least too many) use passwords like
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   520
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   521
\begin{center}
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   522
\pcode{123456},
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   523
\pcode{password},
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   524
\pcode{qwerty},
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   525
\pcode{letmein},
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   526
\pcode{...}
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   527
\end{center}
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   528
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   529
\noindent So an attacker just needs to compile a list as large
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   530
as possible of such likely candidates of passwords and also
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   531
compute their hash-values. The difference between a brute
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   532
force attack, where maybe $2^{80}$ many strings need to be
227
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   533
considered, is that a dictionary attack might get away with
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   534
checking only 10 Million words (remember the language English
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   535
``only'' contains 600,000 words). This is a drastic
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   536
simplification for attackers. Now, if the attacker knows the
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   537
hash-value of a password is
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   538
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   539
\begin{center}
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   540
\pcode{5baa61e4c9b93f3f0682250b6cf8331b7ee68fd8}
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   541
\end{center}
179
1cacbe5c67cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 178
diff changeset
   542
227
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   543
\noindent then just a lookup in the dictionary will reveal
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   544
that the plain-text password was \pcode{password}. What is
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   545
good about this attack is that the dictionary can be
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   546
precompiled in the ``comfort of the hacker's home'' before an
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   547
actual attack is launched. It just needs sufficient storage
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   548
space, which nowadays is pretty cheap. A hacker might in this
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   549
way not be able to crack all passwords in our database, but
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   550
even being able to crack 50\% can be serious damage for a
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   551
large company (because then you have to think about how to
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   552
make users to change their old passwords---a major hassle).
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   553
And hackers are very industrious in compiling these
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   554
dictionaries: for example they definitely include variations
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   555
like \pcode{passw0rd} and also include rules that cover cases
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   556
like \pcode{passwordpassword} or \pcode{drowssap} (password
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   557
reversed).\footnote{Some entertaining rules for creating
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   558
effective dictionaries are described in the book ``Applied
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   559
Cryptography'' by Bruce Schneier (in case you can find it in
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   560
the library), and also in the original research literature
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   561
which can be accessed for free from
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   562
\url{http://www.klein.com/dvk/publications/passwd.pdf}.}
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   563
Historically, compiling a list for a dictionary attack is not
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   564
as simple as it might seem. At the beginning only ``real''
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   565
dictionaries were available (like the Oxford English
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   566
Dictionary), but such dictionaries are not optimised for the
381
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   567
purpose of cracking passwords. The first real hard data about
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   568
actually used passwords was obtained when a company called
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   569
RockYou ``lost'' at the end of 2009 32 Million plain-text
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   570
passwords. With this data of real-life passwords, dictionary
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   571
attacks took off. Compiling such dictionaries is nowadays very
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   572
easy with the help of off-the-shelf tools.
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   573
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   574
These dictionary attacks can be prevented by using salts.
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   575
Remember a hacker needs to use the most likely candidates 
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   576
of passwords and calculate their hash-value. If we add before
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   577
hashing a password a random salt, like \pcode{mPX2aq},
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   578
then the string \pcode{passwordmPX2aq} will almost certainly 
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   579
not be in the dictionary. Like in the web-application in the
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   580
previous section, a salt does not prevent us from verifying a 
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   581
password. We just need to add the salt whenever the password 
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   582
is typed in again. 
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   583
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   584
There is a question whether we should use a single random salt
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   585
for every password in our database. A single salt would
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   586
already make dictionary attacks considerably more difficult.
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   587
It turns out, however, that in case of password databases
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   588
every password should get their own salt. This salt is
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   589
generated at the time when the password is first set. 
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   590
If you look at a Unix password file you will find entries like
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   591
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   592
\begin{center}
288
fd4bf1a2d38d updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 263
diff changeset
   593
\pcode{urbanc:$6$3WWbKfr1$4vblknvGr6FcDeF92R5xFn3mskfdnEn...$...}
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   594
\end{center}
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   595
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   596
\noindent where the first part is the login-name, followed by
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   597
a field \pcode{$6$} which specifies which hash-function is
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   598
used. After that follows the salt \pcode{3WWbKfr1} and after
227
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   599
that the hash-value that is stored for the password (which
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   600
includes the salt). I leave it to you to figure out how the
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   601
password verification would need to work based on this data.
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   602
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   603
There is a non-obvious benefit of using a separate salt for
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   604
each password. Recall that \pcode{123456} is a popular
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   605
password that is most likely used by several of your users
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   606
(especially if the database contains millions of entries). If
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   607
we use no salt or one global salt, all hash-values will be the
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   608
same for this password. So if a hacker is in the business of
186
f7aa15984301 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 185
diff changeset
   609
cracking as many passwords as possible, then it is a good idea
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   610
to concentrate on those very popular passwords. This is not
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   611
possible if each password gets its own salt: since we assume
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   612
the salt is generated randomly, each version of \pcode{123456}
184
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   613
will be associated with a different hash-value. This will
55968b3205cc updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 183
diff changeset
   614
make the life harder for an attacker.
182
681e35f6b0e4 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 181
diff changeset
   615
227
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   616
Note another interesting point. The web-application from the
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   617
previous section was only secure when the salt was secret. In
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   618
the password case, this is not needed. The salt can be public
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   619
as shown above in the Unix password file where it is actually
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   620
stored as part of the password entry. Knowing the salt does
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   621
not give the attacker any advantage, but prevents that
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   622
dictionaries can be precompiled. While salts do not solve
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   623
every problem, they help with protecting against dictionary
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   624
attacks on password files. It protects people who have the
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   625
same passwords on multiple machines. But it does not protect
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   626
against a focused attack against a single password and also
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   627
does not make poorly chosen passwords any better. Still the
7807863c4196 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 186
diff changeset
   628
moral is that you should never store passwords in plain text.
262
57269d9931da updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 227
diff changeset
   629
Never ever.
57269d9931da updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 227
diff changeset
   630
57269d9931da updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 227
diff changeset
   631
\subsubsection*{Further Reading}
174
e2180cead443 updated handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 173
diff changeset
   632
379
11f5f86bf956 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 370
diff changeset
   633
A readable article by Bruce Schneier on ``How Security Companies Sucker Us with 
312
c913fe9bfd59 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 291
diff changeset
   634
Lemons''
c913fe9bfd59 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 291
diff changeset
   635
c913fe9bfd59 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 291
diff changeset
   636
\begin{center}
c913fe9bfd59 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 291
diff changeset
   637
\url{http://archive.wired.com/politics/security/commentary/securitymatters/2007/04/securitymatters_0419}
c913fe9bfd59 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 291
diff changeset
   638
\end{center}
c913fe9bfd59 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 291
diff changeset
   639
c913fe9bfd59 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 291
diff changeset
   640
\noindent
443
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   641
A recent research paper about surveillance using cookies is
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   642
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   643
\begin{center}
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   644
\url{http://randomwalker.info/publications/cookie-surveillance-v2.pdf}
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   645
\end{center}
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   646
67d7d239c617 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 431
diff changeset
   647
\noindent
291
18b726d2b67c updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 288
diff changeset
   648
A slightly different point of view about the economies of 
18b726d2b67c updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 288
diff changeset
   649
password cracking:
288
fd4bf1a2d38d updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 263
diff changeset
   650
fd4bf1a2d38d updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 263
diff changeset
   651
\begin{center}
325
48c6751f2173 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 312
diff changeset
   652
\url{http://xkcd.com/538/}
288
fd4bf1a2d38d updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 263
diff changeset
   653
\end{center}
fd4bf1a2d38d updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 263
diff changeset
   654
365
942205605c30 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 358
diff changeset
   655
\noindent If you want to know more about passwords, the book
942205605c30 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 358
diff changeset
   656
by Bruce Schneier about Applied Cryptography is recommendable,
942205605c30 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 358
diff changeset
   657
though quite expensive. There is also another expensive book
942205605c30 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 358
diff changeset
   658
about penetration testing, but the readable chapter about
942205605c30 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 358
diff changeset
   659
password attacks (Chapter 9) is free:
262
57269d9931da updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 227
diff changeset
   660
57269d9931da updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 227
diff changeset
   661
\begin{center}
57269d9931da updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 227
diff changeset
   662
\url{http://www.nostarch.com/pentesting}
57269d9931da updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 227
diff changeset
   663
\end{center}
57269d9931da updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 227
diff changeset
   664
379
11f5f86bf956 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 370
diff changeset
   665
\noindent Even the government recently handed out some 
11f5f86bf956 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 370
diff changeset
   666
advice about passwords
11f5f86bf956 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 370
diff changeset
   667
11f5f86bf956 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 370
diff changeset
   668
\begin{center}
11f5f86bf956 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 370
diff changeset
   669
\url{http://goo.gl/dIzqMg}
11f5f86bf956 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 370
diff changeset
   670
\end{center}
11f5f86bf956 updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 370
diff changeset
   671
381
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   672
\noindent Here is an interesting blog-post about how a group
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   673
``cracked'' efficiently millions of bcrypt passwords from the
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   674
Ashley Madison leak.
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   675
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   676
\begin{center}
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   677
\url{http://goo.gl/83Ho0N}
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   678
\end{center}
036a762b02cf updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 379
diff changeset
   679
262
57269d9931da updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 227
diff changeset
   680
\noindent Clearly, passwords are a technology that comes to
57269d9931da updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 227
diff changeset
   681
the end of its usefulness, because brute force attacks become
57269d9931da updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 227
diff changeset
   682
more and more powerful and it is unlikely that humans get any
57269d9931da updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 227
diff changeset
   683
better in remembering (securely) longer and longer passwords.
57269d9931da updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 227
diff changeset
   684
The big question is which technology can replace
288
fd4bf1a2d38d updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 263
diff changeset
   685
passwords\ldots 
358
8787c16bc26e updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 355
diff changeset
   686
\medskip
8787c16bc26e updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 355
diff changeset
   687
288
fd4bf1a2d38d updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 263
diff changeset
   688
fd4bf1a2d38d updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 263
diff changeset
   689
\end{document}
fd4bf1a2d38d updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 263
diff changeset
   690
370
ddac52c0014c updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 366
diff changeset
   691
%%% fingerprints  vs. passwords (what is better)
ddac52c0014c updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 366
diff changeset
   692
https://www.youtube.com/watch?v=VVxL9ymiyAU&feature=youtu.be
ddac52c0014c updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 366
diff changeset
   693
ddac52c0014c updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 366
diff changeset
   694
%%% cookies
ddac52c0014c updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 366
diff changeset
   695
http://randomwalker.info/publications/cookie-surveillance-v2.pdf
288
fd4bf1a2d38d updated
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents: 263
diff changeset
   696
158
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
   697
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
   698
%%% Local Variables: 
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
   699
%%% mode: latex
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
   700
%%% TeX-master: t
702fea7754eb added handouts
Christian Urban <christian dot urban at kcl dot ac dot uk>
parents:
diff changeset
   701
%%% End: