|
532
|
1 |
% Chapter Template
|
|
|
2 |
|
|
|
3 |
\chapter{Finiteness Bound} % Main chapter title
|
|
|
4 |
|
|
|
5 |
\label{Finite}
|
|
|
6 |
% In Chapter 4 \ref{Chapter4} we give the second guarantee
|
|
|
7 |
%of our bitcoded algorithm, that is a finite bound on the size of any
|
|
|
8 |
%regex's derivatives.
|
|
|
9 |
|
|
576
|
10 |
In this chapter we give a guarantee in terms of size:
|
|
590
|
11 |
given an annotated regular expression $a$, for any string $s$
|
|
|
12 |
our algorithm $\blexersimp$'s internal annotated regular expression
|
|
|
13 |
size is finitely bounded
|
|
|
14 |
by a constant $N_a$ that only depends on $a$:
|
|
576
|
15 |
\begin{center}
|
|
593
|
16 |
$\llbracket \bderssimp{a}{s} \rrbracket \leq N_a$
|
|
576
|
17 |
\end{center}
|
|
|
18 |
\noindent
|
|
577
|
19 |
where the size of an annotated regular expression is defined
|
|
|
20 |
in terms of the number of nodes in its tree structure:
|
|
|
21 |
\begin{center}
|
|
593
|
22 |
\begin{tabular}{ccc}
|
|
|
23 |
$\llbracket _{bs}\ONE \rrbracket$ & $\dn$ & $1$\\
|
|
|
24 |
$\llbracket \ZERO \rrbracket$ & $\dn$ & $1$ \\
|
|
|
25 |
$\llbracket _{bs} r_1 \cdot r_2 \rrbracket$ & $\dn$ & $\llbracket r_1 \rrbracket + \llbracket r_2 \rrbracket + 1$\\
|
|
|
26 |
$\llbracket _{bs}\mathbf{c} \rrbracket $ & $\dn$ & $1$\\
|
|
|
27 |
$\llbracket _{bs}\sum as \rrbracket $ & $\dn$ & $\map \; (\llbracket \_ \rrbracket)\; as + 1$\\
|
|
|
28 |
$\llbracket _{bs} a^* \rrbracket $ & $\dn$ & $\llbracket a \rrbracket + 1$.
|
|
|
29 |
\end{tabular}
|
|
577
|
30 |
\end{center}
|
|
590
|
31 |
We believe this size formalisation
|
|
|
32 |
of the algorithm is important in our context, because
|
|
|
33 |
\begin{itemize}
|
|
|
34 |
\item
|
|
|
35 |
It is a stepping stone towards an ``absence of catastrophic-backtracking''
|
|
|
36 |
guarantee. The next step would be to refine the bound $N_a$ so that it
|
|
|
37 |
is polynomial on $\llbracket a\rrbracket$.
|
|
|
38 |
\item
|
|
|
39 |
The size bound proof gives us a higher confidence that
|
|
|
40 |
our simplification algorithm $\simp$ does not ``mis-behave''
|
|
|
41 |
like $\simpsulz$ does.
|
|
|
42 |
The bound is universal, which is an advantage over work which
|
|
|
43 |
only gives empirical evidence on some test cases.
|
|
|
44 |
\end{itemize}
|
|
576
|
45 |
\section{Formalising About Size}
|
|
577
|
46 |
\noindent
|
|
576
|
47 |
In our lexer $\blexersimp$,
|
|
|
48 |
The regular expression is repeatedly being taken derivative of
|
|
|
49 |
and then simplified.
|
|
590
|
50 |
\begin{figure}[H]
|
|
593
|
51 |
\begin{tikzpicture}[scale=2,
|
|
|
52 |
every node/.style={minimum size=11mm},
|
|
|
53 |
->,>=stealth',shorten >=1pt,auto,thick
|
|
|
54 |
]
|
|
|
55 |
\node (r0) [rectangle, draw=black, thick, minimum size = 5mm, draw=blue] {$a$};
|
|
|
56 |
\node (r1) [rectangle, draw=black, thick, right=of r0, minimum size = 7mm]{$a_1$};
|
|
|
57 |
\draw[->,line width=0.2mm](r0)--(r1) node[above,midway] {$\backslash c_1$};
|
|
590
|
58 |
|
|
593
|
59 |
\node (r1s) [rectangle, draw=blue, thick, right=of r1, minimum size=6mm]{$a_{1s}$};
|
|
|
60 |
\draw[->, line width=0.2mm](r1)--(r1s) node[above, midway] {$\simp$};
|
|
590
|
61 |
|
|
593
|
62 |
\node (r2) [rectangle, draw=black, thick, right=of r1s, minimum size = 12mm]{$a_2$};
|
|
|
63 |
\draw[->,line width=0.2mm](r1s)--(r2) node[above,midway] {$\backslash c_2$};
|
|
590
|
64 |
|
|
593
|
65 |
\node (r2s) [rectangle, draw = blue, thick, right=of r2,minimum size=6mm]{$a_{2s}$};
|
|
|
66 |
\draw[->,line width=0.2mm](r2)--(r2s) node[above,midway] {$\simp$};
|
|
590
|
67 |
|
|
593
|
68 |
\node (rns) [rectangle, draw = blue, thick, right=of r2s,minimum size=6mm]{$a_{ns}$};
|
|
|
69 |
\draw[->,line width=0.2mm, dashed](r2s)--(rns) node[above,midway] {$\backslash \ldots$};
|
|
590
|
70 |
|
|
593
|
71 |
\node (v) [circle, thick, draw, right=of rns, minimum size=6mm, right=1.7cm]{$v$};
|
|
|
72 |
\draw[->, line width=0.2mm](rns)--(v) node[above, midway] {\bmkeps} node [below, midway] {\decode};
|
|
|
73 |
\end{tikzpicture}
|
|
|
74 |
\caption{Regular expression size change during our $\blexersimp$ algorithm}\label{simpShrinks}
|
|
590
|
75 |
\end{figure}
|
|
576
|
76 |
\noindent
|
|
590
|
77 |
Each time
|
|
|
78 |
a derivative is taken, a regular expression might grow a bit,
|
|
|
79 |
but simplification always takes care that
|
|
|
80 |
it stays small.
|
|
577
|
81 |
This intuition is depicted by the relative size
|
|
590
|
82 |
change between the black and blue nodes:
|
|
|
83 |
After $\simp$ the node always shrinks.
|
|
|
84 |
Our proof says that all the blue nodes
|
|
|
85 |
stay below a size bound $N_a$ determined by $a$.
|
|
576
|
86 |
|
|
590
|
87 |
\noindent
|
|
|
88 |
Sulzmann and Lu's assumed something similar about their algorithm,
|
|
|
89 |
though in fact their algorithm's size might be better depicted by the following graph:
|
|
|
90 |
\begin{figure}[H]
|
|
593
|
91 |
\begin{tikzpicture}[scale=2,
|
|
|
92 |
every node/.style={minimum size=11mm},
|
|
|
93 |
->,>=stealth',shorten >=1pt,auto,thick
|
|
|
94 |
]
|
|
|
95 |
\node (r0) [rectangle, draw=black, thick, minimum size = 5mm, draw=blue] {$a$};
|
|
|
96 |
\node (r1) [rectangle, draw=black, thick, right=of r0, minimum size = 7mm]{$a_1$};
|
|
|
97 |
\draw[->,line width=0.2mm](r0)--(r1) node[above,midway] {$\backslash c_1$};
|
|
590
|
98 |
|
|
593
|
99 |
\node (r1s) [rectangle, draw=blue, thick, right=of r1, minimum size=7mm]{$a_{1s}$};
|
|
|
100 |
\draw[->, line width=0.2mm](r1)--(r1s) node[above, midway] {$\simp'$};
|
|
590
|
101 |
|
|
593
|
102 |
\node (r2) [rectangle, draw=black, thick, right=of r1s, minimum size = 17mm]{$a_2$};
|
|
|
103 |
\draw[->,line width=0.2mm](r1s)--(r2) node[above,midway] {$\backslash c_2$};
|
|
590
|
104 |
|
|
593
|
105 |
\node (r2s) [rectangle, draw = blue, thick, right=of r2,minimum size=14mm]{$a_{2s}$};
|
|
|
106 |
\draw[->,line width=0.2mm](r2)--(r2s) node[above,midway] {$\simp'$};
|
|
590
|
107 |
|
|
593
|
108 |
\node (r3) [rectangle, draw = black, thick, right= of r2s, minimum size = 22mm]{$a_3$};
|
|
|
109 |
\draw[->,line width=0.2mm](r2s)--(r3) node[above,midway] {$\backslash c_3$};
|
|
590
|
110 |
|
|
593
|
111 |
\node (rns) [right = of r3, draw=blue, minimum size = 20mm]{$a_{3s}$};
|
|
|
112 |
\draw[->,line width=0.2mm] (r3)--(rns) node [above, midway] {$\simp'$};
|
|
590
|
113 |
|
|
593
|
114 |
\node (rnn) [right = of rns, minimum size = 1mm]{};
|
|
|
115 |
\draw[->, dashed] (rns)--(rnn) node [above, midway] {$\ldots$};
|
|
590
|
116 |
|
|
593
|
117 |
\end{tikzpicture}
|
|
|
118 |
\caption{Regular expression size change during our $\blexersimp$ algorithm}\label{sulzShrinks}
|
|
590
|
119 |
\end{figure}
|
|
|
120 |
\noindent
|
|
|
121 |
That is, on certain cases their lexer
|
|
576
|
122 |
will have an indefinite size explosion, causing the running time
|
|
590
|
123 |
of each derivative step to grow arbitrarily large (for example
|
|
|
124 |
in \ref{SulzmannLuLexerTime}).
|
|
|
125 |
The reason they made this mistake was that
|
|
|
126 |
they tested out the run time of their
|
|
|
127 |
lexer on particular examples such as $(a+b+ab)^*$
|
|
|
128 |
and generalised to all cases, which
|
|
|
129 |
cannot happen with our mecahnised proof.\\
|
|
|
130 |
We give details of the proof in the next sections.
|
|
|
131 |
|
|
577
|
132 |
\subsection{Overview of the Proof}
|
|
|
133 |
Here is a bird's eye view of how the proof of finiteness works,
|
|
|
134 |
which involves three steps:
|
|
593
|
135 |
\begin{figure}[H]
|
|
|
136 |
\begin{tikzpicture}[scale=1,font=\bf,
|
|
|
137 |
node/.style={
|
|
|
138 |
rectangle,rounded corners=3mm,
|
|
|
139 |
ultra thick,draw=black!50,minimum height=18mm,
|
|
|
140 |
minimum width=20mm,
|
|
|
141 |
top color=white,bottom color=black!20}]
|
|
543
|
142 |
|
|
|
143 |
|
|
593
|
144 |
\node (0) at (-5,0)
|
|
|
145 |
[node, text width=1.8cm, text centered]
|
|
|
146 |
{$\llbracket \bderssimp{a}{s} \rrbracket$};
|
|
|
147 |
\node (A) at (0,0)
|
|
|
148 |
[node,text width=1.6cm, text centered]
|
|
|
149 |
{$\llbracket \rderssimp{r}{s} \rrbracket_r$};
|
|
|
150 |
\node (B) at (3,0)
|
|
|
151 |
[node,text width=3.0cm, anchor=west, minimum width = 40mm]
|
|
|
152 |
{$\llbracket \textit{ClosedForm}(r, s)\rrbracket_r$};
|
|
|
153 |
\node (C) at (9.5,0) [node, minimum width=10mm] {$N_r$};
|
|
|
154 |
|
|
|
155 |
\draw [->,line width=0.5mm] (0) --
|
|
|
156 |
node [above,pos=0.45] {=} (A) node [below, pos = 0.45] {$(r = a \downarrow_r)$} (A);
|
|
|
157 |
\draw [->,line width=0.5mm] (A) --
|
|
|
158 |
node [above,pos=0.35] {$\quad =\ldots=$} (B);
|
|
|
159 |
\draw [->,line width=0.5mm] (B) --
|
|
|
160 |
node [above,pos=0.35] {$\quad \leq \ldots \leq$} (C);
|
|
|
161 |
\end{tikzpicture}
|
|
|
162 |
%\caption{
|
|
|
163 |
\end{figure}
|
|
576
|
164 |
\noindent
|
|
577
|
165 |
We explain the steps one by one:
|
|
532
|
166 |
\begin{itemize}
|
|
590
|
167 |
\item
|
|
|
168 |
We first introduce the operations such as
|
|
|
169 |
derivatives, simplification, size calculation, etc.
|
|
|
170 |
associated with $\rrexp$s, which we have given
|
|
|
171 |
a very brief introduction to in chapter \ref{Bitcoded2}.
|
|
593
|
172 |
The operations on $\rrexp$s are identical to those on
|
|
|
173 |
annotated regular expressions except that they are unaware
|
|
|
174 |
of bitcodes. This means that all proofs about size of $\rrexp$s will apply to
|
|
|
175 |
annotated regular expressions.
|
|
590
|
176 |
\item
|
|
593
|
177 |
We prove that $\rderssimp{r}{s} = \textit{ClosedForm}(r, s)$,
|
|
|
178 |
where $\textit{ClosedForm}(r, s)$ is entirely
|
|
|
179 |
written in the derivatives of their children regular
|
|
|
180 |
expressions.
|
|
|
181 |
We call the right-hand-side the \emph{Closed Form}
|
|
|
182 |
of the derivative $\rderssimp{r}{s}$.
|
|
590
|
183 |
\item
|
|
593
|
184 |
We estimate $\llbracket \textit{ClosedForm}(r, s) \rrbracket_r$.
|
|
|
185 |
The key observation is that $\distinctBy$'s output is
|
|
|
186 |
a list with a constant length bound.
|
|
532
|
187 |
\end{itemize}
|
|
594
|
188 |
We will expand on these steps in the next sections.\\
|
|
532
|
189 |
|
|
593
|
190 |
\section{The $\textit{Rrexp}$ Datatype and Its Lexing-Related Functions}
|
|
594
|
191 |
The first step is to define
|
|
|
192 |
$\textit{rrexp}$s.
|
|
|
193 |
They are without bitcodes,
|
|
|
194 |
allowing a much simpler size bound proof.
|
|
|
195 |
Of course, the bits which encode the lexing information
|
|
|
196 |
would grow linearly with respect
|
|
|
197 |
to the input, which should be taken into account when we wish to tackle the runtime comlexity.
|
|
|
198 |
But for the sake of the structural size
|
|
|
199 |
we can safely ignore them.\\
|
|
|
200 |
To recapitulate, the datatype
|
|
|
201 |
definition of the $\rrexp$, called
|
|
593
|
202 |
\emph{r-regular expressions},
|
|
594
|
203 |
was initially defined in \ref{rrexpDef}.
|
|
|
204 |
The reason for the prefix $r$ is
|
|
593
|
205 |
to make a distinction
|
|
594
|
206 |
with basic regular expressions.
|
|
576
|
207 |
\[ \rrexp ::= \RZERO \mid \RONE
|
|
593
|
208 |
\mid \RCHAR{c}
|
|
|
209 |
\mid \RSEQ{r_1}{r_2}
|
|
|
210 |
\mid \RALTS{rs}
|
|
|
211 |
\mid \RSTAR{r}
|
|
576
|
212 |
\]
|
|
593
|
213 |
The size of an r-regular expression is
|
|
|
214 |
written $\llbracket r\rrbracket_r$,
|
|
|
215 |
whose definition mirrors that of an annotated regular expression.
|
|
576
|
216 |
\begin{center}
|
|
593
|
217 |
\begin{tabular}{ccc}
|
|
|
218 |
$\llbracket _{bs}\ONE \rrbracket_r$ & $\dn$ & $1$\\
|
|
|
219 |
$\llbracket \ZERO \rrbracket_r$ & $\dn$ & $1$ \\
|
|
|
220 |
$\llbracket _{bs} r_1 \cdot r_2 \rrbracket_r$ & $\dn$ & $\llbracket r_1 \rrbracket_r + \llbracket r_2 \rrbracket_r + 1$\\
|
|
|
221 |
$\llbracket _{bs}\mathbf{c} \rrbracket_r $ & $\dn$ & $1$\\
|
|
|
222 |
$\llbracket _{bs}\sum as \rrbracket_r $ & $\dn$ & $\map \; (\llbracket \_ \rrbracket_r)\; as + 1$\\
|
|
|
223 |
$\llbracket _{bs} a^* \rrbracket_r $ & $\dn$ & $\llbracket a \rrbracket_r + 1$.
|
|
|
224 |
\end{tabular}
|
|
576
|
225 |
\end{center}
|
|
|
226 |
\noindent
|
|
593
|
227 |
The $r$ in the subscript of $\llbracket \rrbracket_r$ is to
|
|
|
228 |
differentiate with the same operation for annotated regular expressions.
|
|
|
229 |
Adding $r$ as subscript will be used in
|
|
594
|
230 |
other operations as well.\\
|
|
593
|
231 |
The transformation from an annotated regular expression
|
|
|
232 |
to an r-regular expression is straightforward.
|
|
|
233 |
\begin{center}
|
|
|
234 |
\begin{tabular}{lcl}
|
|
|
235 |
$\rerase{\ZERO}$ & $\dn$ & $\RZERO$\\
|
|
|
236 |
$\rerase{_{bs}\ONE}$ & $\dn$ & $\RONE$\\
|
|
|
237 |
$\rerase{_{bs}\mathbf{c}}$ & $\dn$ & $\RCHAR{c}$\\
|
|
|
238 |
$\rerase{_{bs}r_1\cdot r_2}$ & $\dn$ & $\RSEQ{\rerase{r_1}}{\rerase{r_2}}$\\
|
|
|
239 |
$\rerase{_{bs}\sum as}$ & $\dn$ & $\RALTS{\map \; \rerase{\_} \; as}$\\
|
|
|
240 |
$\rerase{_{bs} a ^*}$ & $\dn$ & $\rerase{a} ^*$
|
|
|
241 |
\end{tabular}
|
|
|
242 |
\end{center}
|
|
576
|
243 |
\noindent
|
|
594
|
244 |
$\textit{Rerase}$ throws away the bitcodes
|
|
|
245 |
on the annotated regular expressions,
|
|
593
|
246 |
but keeps everything else intact.
|
|
594
|
247 |
Therefore it does not change the size
|
|
|
248 |
of an annotated regular expression:
|
|
|
249 |
\begin{lemma}\label{rsizeAsize}
|
|
593
|
250 |
$\rsize{\rerase a} = \asize a$
|
|
|
251 |
\end{lemma}
|
|
|
252 |
\begin{proof}
|
|
|
253 |
By routine structural induction on $a$.
|
|
|
254 |
\end{proof}
|
|
|
255 |
\noindent
|
|
594
|
256 |
|
|
576
|
257 |
\subsection{Motivation Behind a New Datatype}
|
|
594
|
258 |
The reason we take all the trouble
|
|
|
259 |
defining a new datatype is that $\erase$ makes things harder.
|
|
576
|
260 |
We initially started by using
|
|
|
261 |
plain regular expressions and tried to prove
|
|
594
|
262 |
the lemma \ref{rsizeAsize},
|
|
|
263 |
however the $\erase$ function unavoidbly messes with the structure of the
|
|
|
264 |
annotated regular expression.
|
|
|
265 |
The $+$ constructor
|
|
|
266 |
of basic regular expressions is binary whereas $\sum$
|
|
|
267 |
takes a list, and one has to convert between them:
|
|
576
|
268 |
\begin{center}
|
|
594
|
269 |
\begin{tabular}{ccc}
|
|
|
270 |
$\erase \; _{bs}\sum [] $ & $\dn$ & $\ZERO$\\
|
|
|
271 |
$\erase \; _{bs}\sum [a]$ & $\dn$ & $a$\\
|
|
|
272 |
$\erase \; _{bs}\sum a :: as$ & $\dn$ & $a + (\erase \; _{[]} \sum as)\quad \text{if $as$ length over 1}$
|
|
|
273 |
\end{tabular}
|
|
576
|
274 |
\end{center}
|
|
594
|
275 |
\noindent
|
|
|
276 |
An alternative regular expression with an empty argument list
|
|
|
277 |
will be turned into a $\ZERO$.
|
|
|
278 |
The singleton alternative $\sum [r]$ would have $r$ during the
|
|
|
279 |
$\erase$ function.
|
|
|
280 |
The annotated regular expression $\sum[a, b, c]$ would turn into
|
|
|
281 |
$(a+(b+c))$.
|
|
|
282 |
All these operations change the size and structure of
|
|
|
283 |
an annotated regular expressions, adding unnecessary
|
|
|
284 |
complexities to the size bound proof.\\
|
|
|
285 |
For example, if we define the size of a basic regular expression
|
|
|
286 |
in the usual way,
|
|
543
|
287 |
\begin{center}
|
|
593
|
288 |
\begin{tabular}{ccc}
|
|
|
289 |
$\llbracket \ONE \rrbracket_p$ & $\dn$ & $1$\\
|
|
|
290 |
$\llbracket \ZERO \rrbracket_p$ & $\dn$ & $1$ \\
|
|
|
291 |
$\llbracket r_1 \cdot r_2 \rrbracket_p$ & $\dn$ & $\llbracket r_1 \rrbracket_p + \llbracket r_2 \rrbracket_p + 1$\\
|
|
|
292 |
$\llbracket \mathbf{c} \rrbracket_p $ & $\dn$ & $1$\\
|
|
|
293 |
$\llbracket r_1 \cdot r_2 \rrbracket_p $ & $\dn$ & $\llbracket r_1 \rrbracket_p \; + \llbracket r_2 \rrbracket_p + 1$\\
|
|
|
294 |
$\llbracket a^* \rrbracket_p $ & $\dn$ & $\llbracket a \rrbracket_p + 1$
|
|
|
295 |
\end{tabular}
|
|
532
|
296 |
\end{center}
|
|
543
|
297 |
\noindent
|
|
594
|
298 |
Then the property
|
|
532
|
299 |
\begin{center}
|
|
594
|
300 |
$\llbracket a \rrbracket = \llbracket a_\downarrow \rrbracket_p$
|
|
532
|
301 |
\end{center}
|
|
594
|
302 |
does not hold.
|
|
|
303 |
One might be able to prove an inequality such as
|
|
|
304 |
$\llbracket a \rrbracket \leq \llbracket a_\downarrow \rrbracket_p $
|
|
|
305 |
and then estimate $\llbracket a_\downarrow \rrbracket_p$,
|
|
|
306 |
but we found our approach more straightforward.\\
|
|
532
|
307 |
|
|
594
|
308 |
\subsection{Lexing Related Functions for $\rrexp$ such as $\backslash_r$, $\rdistincts$, and $\rsimp$}
|
|
|
309 |
The operations on r-regular expressions are
|
|
|
310 |
almost identical to those of the annotated regular expressions,
|
|
|
311 |
except that no bitcodes are used. For example,
|
|
|
312 |
the derivative operation becomes simpler:\\
|
|
543
|
313 |
\begin{center}
|
|
593
|
314 |
\begin{tabular}{@{}lcl@{}}
|
|
|
315 |
$(\ZERO)\,\backslash_r c$ & $\dn$ & $\ZERO$\\
|
|
|
316 |
$(\ONE)\,\backslash_r c$ & $\dn$ &
|
|
|
317 |
$\textit{if}\;c=d\; \;\textit{then}\;
|
|
|
318 |
\ONE\;\textit{else}\;\ZERO$\\
|
|
|
319 |
$(\sum \;\textit{rs})\,\backslash_r c$ & $\dn$ &
|
|
|
320 |
$\sum\;(\textit{map} \; (\_\backslash_r c) \; rs )$\\
|
|
|
321 |
$(r_1\cdot r_2)\,\backslash_r c$ & $\dn$ &
|
|
594
|
322 |
$\textit{if}\;(\textit{rnullable}\,r_1)$\\
|
|
593
|
323 |
& &$\textit{then}\;\sum\,[(r_1\,\backslash_r c)\cdot\,r_2,$\\
|
|
|
324 |
& &$\phantom{\textit{then},\;\sum\,}((r_2\,\backslash_r c))]$\\
|
|
|
325 |
& &$\textit{else}\;\,(r_1\,\backslash_r c)\cdot r_2$\\
|
|
|
326 |
$(r^*)\,\backslash_r c$ & $\dn$ &
|
|
|
327 |
$( r\,\backslash_r c)\cdot
|
|
|
328 |
(_{[]}r^*))$
|
|
|
329 |
\end{tabular}
|
|
543
|
330 |
\end{center}
|
|
|
331 |
\noindent
|
|
594
|
332 |
Similarly, $\distinctBy$ does not need
|
|
|
333 |
a function checking equivalence because
|
|
|
334 |
there are no bit annotations causing superficial differences
|
|
|
335 |
between syntactically equal terms.
|
|
532
|
336 |
\begin{center}
|
|
593
|
337 |
\begin{tabular}{lcl}
|
|
|
338 |
$\rdistinct{[]}{rset} $ & $\dn$ & $[]$\\
|
|
594
|
339 |
$\rdistinct{r :: rs}{rset}$ & $\dn$ &
|
|
|
340 |
$\textit{if}(r \in \textit{rset}) \; \textit{then} \; \rdistinct{rs}{rset}$\\
|
|
|
341 |
& & $\textit{else}\; \;
|
|
|
342 |
r::\rdistinct{rs}{(rset \cup \{r\})}$
|
|
593
|
343 |
\end{tabular}
|
|
532
|
344 |
\end{center}
|
|
|
345 |
%TODO: definition of rsimp (maybe only the alternative clause)
|
|
543
|
346 |
\noindent
|
|
595
|
347 |
We would like to make clear
|
|
|
348 |
a difference between our $\rdistincts$ and
|
|
|
349 |
the Isabelle $\textit {distinct}$ predicate.
|
|
|
350 |
In Isabelle $\textit{distinct}$ is a function that returns a boolean
|
|
|
351 |
rather than a list.
|
|
|
352 |
It tests if all the elements of a list are unique.\\
|
|
|
353 |
With $\textit{rdistinct}$,
|
|
|
354 |
and the flatten function for $\rrexp$s:
|
|
|
355 |
\begin{center}
|
|
|
356 |
\begin{tabular}{@{}lcl@{}}
|
|
596
|
357 |
$\textit{rflts} \; (\sum \textit{as}) :: \textit{as'}$ & $\dn$ & $as \; @ \; \textit{rflts} \; as' $ \\
|
|
595
|
358 |
$\textit{rflts} \; \ZERO :: as'$ & $\dn$ & $ \textit{rflts} \; \textit{as'} $ \\
|
|
|
359 |
$\textit{rflts} \; a :: as'$ & $\dn$ & $a :: \textit{rflts} \; \textit{as'}$ \quad(otherwise)
|
|
|
360 |
\end{tabular}
|
|
|
361 |
\end{center}
|
|
|
362 |
\noindent
|
|
|
363 |
one can chain together all the other modules
|
|
596
|
364 |
such as $\rsimpalts$:
|
|
|
365 |
\begin{center}
|
|
|
366 |
\begin{tabular}{@{}lcl@{}}
|
|
|
367 |
$\rsimpalts \;\; nil$ & $\dn$ & $\RZERO$\\
|
|
|
368 |
$\rsimpalts \;\; r::nil$ & $\dn$ & $r$\\
|
|
|
369 |
$\rsimpalts \;\; rs$ & $\dn$ & $\sum rs$\\
|
|
|
370 |
\end{tabular}
|
|
|
371 |
\end{center}
|
|
|
372 |
\noindent
|
|
|
373 |
and $\rsimpseq$:
|
|
|
374 |
\begin{center}
|
|
|
375 |
\begin{tabular}{@{}lcl@{}}
|
|
|
376 |
$\rsimpseq \;\; \RZERO \; \_ $ & $=$ & $\RZERO$\\
|
|
|
377 |
$\rsimpseq \;\; \_ \; \RZERO $ & $=$ & $\RZERO$\\
|
|
|
378 |
$\rsimpseq \;\; \RONE \cdot r_2$ & $\dn$ & $r_2$\\
|
|
|
379 |
$\rsimpseq \;\; r_1 r_2$ & $\dn$ & $r_1 \cdot r_2$\\
|
|
|
380 |
\end{tabular}
|
|
|
381 |
\end{center}
|
|
|
382 |
and get $\textit{rsimp}$ and $\rderssimp{\_}{\_}$:
|
|
595
|
383 |
\begin{center}
|
|
|
384 |
\begin{tabular}{@{}lcl@{}}
|
|
|
385 |
|
|
596
|
386 |
$\textit{rsimp} \; (r_1\cdot r_2)$ & $\dn$ & $ \textit{rsimp}_{SEQ} \; bs \;(\textit{rsimp} \; r_1) \; (\textit{rsimp} \; r_2) $ \\
|
|
|
387 |
$\textit{rsimp} \; (_{bs}\sum \textit{rs})$ & $\dn$ & $\textit{rsimp}_{ALTS} \; \textit{bs} \; (\textit{rdistinct} \; ( \textit{rflts} ( \textit{map} \; rsimp \; rs)) \; \rerases \; \varnothing) $ \\
|
|
|
388 |
$\textit{rsimp} \; r$ & $\dn$ & $\textit{r} \qquad \textit{otherwise}$
|
|
595
|
389 |
\end{tabular}
|
|
|
390 |
\end{center}
|
|
596
|
391 |
\begin{center}
|
|
|
392 |
\begin{tabular}{@{}lcl@{}}
|
|
|
393 |
$r\backslash_{rsimp} \, c$ & $\dn$ & $\rsimp \; (r\backslash_r \, c)$
|
|
|
394 |
\end{tabular}
|
|
|
395 |
\end{center}
|
|
|
396 |
|
|
|
397 |
\begin{center}
|
|
|
398 |
\begin{tabular}{@{}lcl@{}}
|
|
601
|
399 |
$r \backslash_{rsimps} \; \; c\!::\!s $ & $\dn$ & $(r \backslash_{rsimp}\, c) \backslash_{rsimps}\, s$ \\
|
|
596
|
400 |
$r \backslash_{rsimps} [\,] $ & $\dn$ & $r$
|
|
|
401 |
\end{tabular}
|
|
|
402 |
\end{center}
|
|
|
403 |
\noindent
|
|
601
|
404 |
We do not define an r-regular expression version of $\blexersimp$,
|
|
|
405 |
as our proof does not involve its use.
|
|
|
406 |
Everything about the size of annotated regular expressions
|
|
|
407 |
can be calculated via the size of r-regular expressions:
|
|
564
|
408 |
\begin{lemma}\label{sizeRelations}
|
|
553
|
409 |
The following equalities hold:
|
|
543
|
410 |
\begin{itemize}
|
|
|
411 |
\item
|
|
601
|
412 |
$\asize{\bsimps \; a} = \rsize{\rsimp{ \rerase{a}}}$
|
|
554
|
413 |
\item
|
|
596
|
414 |
$\asize{\bderssimp{a}{s}} = \rsize{\rderssimp{\rerase{a}}{s}}$
|
|
554
|
415 |
\end{itemize}
|
|
532
|
416 |
\end{lemma}
|
|
601
|
417 |
\begin{proof}
|
|
|
418 |
The first part is by induction on the inductive cases
|
|
|
419 |
of $\textit{bsimp}$.
|
|
|
420 |
The second part is by induction on the string $s$,
|
|
|
421 |
where the inductive step follows from part one.
|
|
|
422 |
\end{proof}
|
|
543
|
423 |
\noindent
|
|
596
|
424 |
With lemma \ref{sizeRelations},
|
|
601
|
425 |
we will be able to focus on
|
|
|
426 |
estimating only
|
|
|
427 |
$\rsize{\rderssimp{\rerase{a}}{s}}$
|
|
|
428 |
in later parts because
|
|
|
429 |
\begin{center}
|
|
|
430 |
$\rsize{\rderssimp{\rerase{a}}{s}} \leq N_r \quad$
|
|
|
431 |
implies
|
|
|
432 |
$\quad \llbracket a \backslash_{bsimps} s \rrbracket \leq N_r$.
|
|
|
433 |
\end{center}
|
|
|
434 |
Unless stated otherwise in the rest of this
|
|
|
435 |
chapter all regular expressions without
|
|
593
|
436 |
bitcodes are seen as $\rrexp$s.
|
|
601
|
437 |
For the binary alternative r-regular expression $\RALTS{[r_1, r_2]}$,
|
|
|
438 |
we use the notation $r_1 + r_2$
|
|
|
439 |
for brevity.
|
|
532
|
440 |
|
|
|
441 |
|
|
|
442 |
%-----------------------------------
|
|
596
|
443 |
% SUB SECTION ROADMAP RREXP BOUND
|
|
532
|
444 |
%-----------------------------------
|
|
553
|
445 |
|
|
596
|
446 |
%\subsection{Roadmap to a Bound for $\textit{Rrexp}$}
|
|
553
|
447 |
|
|
596
|
448 |
%The way we obtain the bound for $\rrexp$s is by two steps:
|
|
|
449 |
%\begin{itemize}
|
|
|
450 |
% \item
|
|
|
451 |
% First, we rewrite $r\backslash s$ into something else that is easier
|
|
|
452 |
% to bound. This step is especially important for the inductive case
|
|
|
453 |
% $r_1 \cdot r_2$ and $r^*$, where the derivative can grow and bloat in a wild way,
|
|
|
454 |
% but after simplification they will always be equal or smaller to a form consisting of an alternative
|
|
|
455 |
% list of regular expressions $f \; (g\; (\sum rs))$ with some functions applied to it, where each element will be distinct after the function application.
|
|
|
456 |
% \item
|
|
|
457 |
% Then, for such a sum list of regular expressions $f\; (g\; (\sum rs))$, we can control its size
|
|
|
458 |
% by estimation, since $\distinctBy$ and $\flts$ are well-behaved and working together would only
|
|
|
459 |
% reduce the size of a regular expression, not adding to it.
|
|
|
460 |
%\end{itemize}
|
|
|
461 |
%
|
|
|
462 |
%\section{Step One: Closed Forms}
|
|
|
463 |
%We transform the function application $\rderssimp{r}{s}$
|
|
|
464 |
%into an equivalent
|
|
|
465 |
%form $f\; (g \; (\sum rs))$.
|
|
|
466 |
%The functions $f$ and $g$ can be anything from $\flts$, $\distinctBy$ and other helper functions from $\bsimp{\_}$.
|
|
|
467 |
%This way we get a different but equivalent way of expressing : $r\backslash s = f \; (g\; (\sum rs))$, we call the
|
|
|
468 |
%right hand side the "closed form" of $r\backslash s$.
|
|
|
469 |
%
|
|
|
470 |
%\begin{quote}\it
|
|
|
471 |
% Claim: For regular expressions $r_1 \cdot r_2$, we claim that
|
|
|
472 |
% \begin{center}
|
|
|
473 |
% $ \rderssimp{r_1 \cdot r_2}{s} =
|
|
|
474 |
% \rsimp{(\sum (r_1 \backslash s \cdot r_2 ) \; :: \;(\map \; \rderssimp{r2}{\_} \;(\vsuf{s}{r_1})))}$
|
|
|
475 |
% \end{center}
|
|
|
476 |
%\end{quote}
|
|
|
477 |
%\noindent
|
|
|
478 |
%We explain in detail how we reached those claims.
|
|
543
|
479 |
\subsection{Basic Properties needed for Closed Forms}
|
|
601
|
480 |
If we attempt to prove
|
|
|
481 |
\begin{center}
|
|
|
482 |
$\forall r. \; \exists N_r.\;\; s.t. \llbracket r\backslash_{bsimps} s \rrbracket_r \leq N_r$
|
|
|
483 |
\end{center}
|
|
|
484 |
using a naive induction on the structure of $r$,
|
|
|
485 |
then we are stuck at the inductive cases such as
|
|
|
486 |
$r_1\cdot r_2$.
|
|
|
487 |
The inductive hypotheses are:
|
|
|
488 |
\begin{center}
|
|
|
489 |
1: $\text{for } r_1, \text{there exists } N_{r_1}.\;\; s.t.
|
|
|
490 |
\;\;\forall s. \llbracket r_1 \backslash_{bsimps} s \rrbracket_r \leq N_{r_1}. $\\
|
|
|
491 |
2: $\text{for } r_2, \text{there exists } N_{r_2}.\;\; s.t.
|
|
|
492 |
\;\; \forall s. \llbracket r_2 \backslash_{bsimps} s \rrbracket_r \leq N_{r_2}. $
|
|
|
493 |
\end{center}
|
|
|
494 |
The inductive step to prove would be
|
|
|
495 |
\begin{center}
|
|
|
496 |
$\text{there exists } N_{r_1\cdot r_2}. \;\; s.t. \forall s.
|
|
|
497 |
\llbracket (r_1 \cdot r_2) \backslash_{bsimps} s \rrbracket_r \leq N_{r_1\cdot r_2}.$
|
|
|
498 |
\end{center}
|
|
|
499 |
The problem is that it is not clear what
|
|
|
500 |
$(r_1\cdot r_2) \backslash_{bsimps} s$ looks like,
|
|
|
501 |
and therefore $N_{r_1}$ and $N_{r_2}$ in the
|
|
|
502 |
inductive hypotheses cannot be directly used.
|
|
|
503 |
|
|
|
504 |
|
|
596
|
505 |
The next steps involves getting a closed form for
|
|
|
506 |
$\rderssimp{r}{s}$ and then obtaining
|
|
|
507 |
an estimate for the closed form.
|
|
543
|
508 |
\subsubsection{$\textit{rdistinct}$'s Deduplicates Successfully}
|
|
|
509 |
The $\textit{rdistinct}$ function, as its name suggests, will
|
|
553
|
510 |
remove duplicates in an \emph{r}$\textit{rexp}$ list,
|
|
|
511 |
according to the accumulator
|
|
543
|
512 |
and leave only one of each different element in a list:
|
|
555
|
513 |
\begin{lemma}\label{rdistinctDoesTheJob}
|
|
543
|
514 |
The function $\textit{rdistinct}$ satisfies the following
|
|
|
515 |
properties:
|
|
|
516 |
\begin{itemize}
|
|
|
517 |
\item
|
|
|
518 |
If $a \in acc$ then $a \notin (\rdistinct{rs}{acc})$.
|
|
|
519 |
\item
|
|
|
520 |
If list $rs'$ is the result of $\rdistinct{rs}{acc}$,
|
|
555
|
521 |
then $\textit{isDistinct} \; rs'$.
|
|
|
522 |
\item
|
|
|
523 |
$\rdistinct{rs}{acc} = rs - acc$
|
|
543
|
524 |
\end{itemize}
|
|
|
525 |
\end{lemma}
|
|
555
|
526 |
\noindent
|
|
|
527 |
The predicate $\textit{isDistinct}$ is for testing
|
|
|
528 |
whether a list's elements are all unique. It is defined
|
|
|
529 |
recursively on the structure of a regular expression,
|
|
|
530 |
and we omit the precise definition here.
|
|
543
|
531 |
\begin{proof}
|
|
|
532 |
The first part is by an induction on $rs$.
|
|
555
|
533 |
The second and third part can be proven by using the
|
|
543
|
534 |
induction rules of $\rdistinct{\_}{\_}$.
|
|
593
|
535 |
|
|
543
|
536 |
\end{proof}
|
|
|
537 |
|
|
|
538 |
\noindent
|
|
|
539 |
$\rdistinct{\_}{\_}$ will cancel out all regular expression terms
|
|
|
540 |
that are in the accumulator, therefore prepending a list $rs_a$ with an arbitrary
|
|
|
541 |
list $rs$ whose elements are all from the accumulator, and then call $\rdistinct{\_}{\_}$
|
|
|
542 |
on the resulting list, the output will be as if we had called $\rdistinct{\_}{\_}$
|
|
|
543 |
without the prepending of $rs$:
|
|
|
544 |
\begin{lemma}
|
|
554
|
545 |
The elements appearing in the accumulator will always be removed.
|
|
|
546 |
More precisely,
|
|
|
547 |
\begin{itemize}
|
|
|
548 |
\item
|
|
|
549 |
If $rs \subseteq rset$, then
|
|
|
550 |
$\rdistinct{rs@rsa }{acc} = \rdistinct{rsa }{acc}$.
|
|
|
551 |
\item
|
|
|
552 |
Furthermore, if $a \in rset$ and $\rdistinct{rs}{\{a\}} = []$,
|
|
|
553 |
then $\rdistinct{(rs @ rs')}{rset} = \rdistinct{rs'}{rset}$
|
|
|
554 |
\end{itemize}
|
|
543
|
555 |
\end{lemma}
|
|
554
|
556 |
|
|
543
|
557 |
\begin{proof}
|
|
|
558 |
By induction on $rs$.
|
|
|
559 |
\end{proof}
|
|
|
560 |
\noindent
|
|
|
561 |
On the other hand, if an element $r$ does not appear in the input list waiting to be deduplicated,
|
|
|
562 |
then expanding the accumulator to include that element will not cause the output list to change:
|
|
|
563 |
\begin{lemma}
|
|
|
564 |
The accumulator can be augmented to include elements not appearing in the input list,
|
|
|
565 |
and the output will not change.
|
|
|
566 |
\begin{itemize}
|
|
|
567 |
\item
|
|
593
|
568 |
If $r \notin rs$, then $\rdistinct{rs}{acc} = \rdistinct{rs}{\{r\} \cup acc}$.
|
|
543
|
569 |
\item
|
|
|
570 |
Particularly, when $acc = \varnothing$ and $rs$ de-duplicated, we have\\
|
|
|
571 |
\[ \rdistinct{rs}{\varnothing} = rs \]
|
|
|
572 |
\end{itemize}
|
|
|
573 |
\end{lemma}
|
|
|
574 |
\begin{proof}
|
|
|
575 |
The first half is by induction on $rs$. The second half is a corollary of the first.
|
|
|
576 |
\end{proof}
|
|
|
577 |
\noindent
|
|
|
578 |
The next property gives the condition for
|
|
|
579 |
when $\rdistinct{\_}{\_}$ becomes an identical mapping
|
|
|
580 |
for any prefix of an input list, in other words, when can
|
|
|
581 |
we ``push out" the arguments of $\rdistinct{\_}{\_}$:
|
|
555
|
582 |
\begin{lemma}\label{distinctRdistinctAppend}
|
|
554
|
583 |
If $\textit{isDistinct} \; rs_1$, and $rs_1 \cap acc = \varnothing$,
|
|
555
|
584 |
then
|
|
553
|
585 |
\[\textit{rdistinct}\; (rs_1 @ rsa)\;\, acc
|
|
|
586 |
= rs_1@(\textit{rdistinct} rsa \; (acc \cup rs_1))\]
|
|
543
|
587 |
\end{lemma}
|
|
554
|
588 |
\noindent
|
|
555
|
589 |
In other words, it can be taken out and left untouched in the output.
|
|
543
|
590 |
\begin{proof}
|
|
593
|
591 |
By an induction on $rs_1$, where $rsa$ and $acc$ are allowed to be arbitrary.
|
|
543
|
592 |
\end{proof}
|
|
554
|
593 |
\noindent
|
|
|
594 |
$\rdistinct{}{}$ removes any element in anywhere of a list, if it
|
|
|
595 |
had appeared previously:
|
|
|
596 |
\begin{lemma}\label{distinctRemovesMiddle}
|
|
|
597 |
The two properties hold if $r \in rs$:
|
|
|
598 |
\begin{itemize}
|
|
|
599 |
\item
|
|
555
|
600 |
$\rdistinct{rs}{rset} = \rdistinct{(rs @ [r])}{rset}$\\
|
|
|
601 |
and\\
|
|
554
|
602 |
$\rdistinct{(ab :: rs @ [ab])}{rset'} = \rdistinct{(ab :: rs)}{rset'}$
|
|
|
603 |
\item
|
|
555
|
604 |
$\rdistinct{ (rs @ rs') }{rset} = \rdistinct{rs @ [r] @ rs'}{rset}$\\
|
|
|
605 |
and\\
|
|
554
|
606 |
$\rdistinct{(ab :: rs @ [ab] @ rs'')}{rset'} =
|
|
593
|
607 |
\rdistinct{(ab :: rs @ rs'')}{rset'}$
|
|
554
|
608 |
\end{itemize}
|
|
|
609 |
\end{lemma}
|
|
|
610 |
\noindent
|
|
|
611 |
\begin{proof}
|
|
593
|
612 |
By induction on $rs$. All other variables are allowed to be arbitrary.
|
|
|
613 |
The second half of the lemma requires the first half.
|
|
|
614 |
Note that for each half's two sub-propositions need to be proven concurrently,
|
|
|
615 |
so that the induction goes through.
|
|
554
|
616 |
\end{proof}
|
|
|
617 |
|
|
555
|
618 |
\noindent
|
|
|
619 |
This allows us to prove ``Idempotency" of $\rdistinct{}{}$ of some kind:
|
|
|
620 |
\begin{lemma}\label{rdistinctConcatGeneral}
|
|
|
621 |
The following equalities involving multiple applications of $\rdistinct{}{}$ hold:
|
|
|
622 |
\begin{itemize}
|
|
|
623 |
\item
|
|
|
624 |
$\rdistinct{(rs @ rs')}{\varnothing} = \rdistinct{((\rdistinct{rs}{\varnothing})@ rs')}{\varnothing}$
|
|
|
625 |
\item
|
|
|
626 |
$\rdistinct{(rs @ rs')}{\varnothing} = \rdistinct{(\rdistinct{rs}{\varnothing} @ rs')}{\varnothing}$
|
|
|
627 |
\item
|
|
|
628 |
If $rset' \subseteq rset$, then $\rdistinct{rs}{rset} =
|
|
|
629 |
\rdistinct{(\rdistinct{rs}{rset'})}{rset}$. As a corollary
|
|
|
630 |
of this,
|
|
|
631 |
\item
|
|
|
632 |
$\rdistinct{(rs @ rs')}{rset} = \rdistinct{
|
|
|
633 |
(\rdistinct{rs}{\varnothing}) @ rs')}{rset}$. This
|
|
|
634 |
gives another corollary use later:
|
|
|
635 |
\item
|
|
|
636 |
If $a \in rset$, then $\rdistinct{(rs @ rs')}{rset} = \rdistinct{
|
|
|
637 |
(\rdistinct{(a :: rs)}{\varnothing} @ rs')}{rset} $,
|
|
|
638 |
|
|
|
639 |
\end{itemize}
|
|
|
640 |
\end{lemma}
|
|
|
641 |
\begin{proof}
|
|
|
642 |
By \ref{rdistinctDoesTheJob} and \ref{distinctRemovesMiddle}.
|
|
|
643 |
\end{proof}
|
|
|
644 |
|
|
553
|
645 |
\subsubsection{The Properties of $\backslash_r$, $\backslash_{rsimp}$, $\textit{Rflts}$ and $\textit{Rsimp}_{ALTS}$}
|
|
|
646 |
We give in this subsection some properties of how $\backslash_r$, $\backslash_{rsimp}$, $\textit{Rflts}$ and $\textit{Rsimp}_{ALTS} $ interact with each other and with $@$, the concatenation operator.
|
|
543
|
647 |
These will be helpful in later closed form proofs, when
|
|
|
648 |
we want to transform the ways in which multiple functions involving
|
|
|
649 |
those are composed together
|
|
|
650 |
in interleaving derivative and simplification steps.
|
|
|
651 |
|
|
|
652 |
When the function $\textit{Rflts}$
|
|
|
653 |
is applied to the concatenation of two lists, the output can be calculated by first applying the
|
|
|
654 |
functions on two lists separately, and then concatenating them together.
|
|
554
|
655 |
\begin{lemma}\label{rfltsProps}
|
|
543
|
656 |
The function $\rflts$ has the below properties:\\
|
|
|
657 |
\begin{itemize}
|
|
|
658 |
\item
|
|
554
|
659 |
$\rflts \; (rs_1 @ rs_2) = \rflts \; rs_1 @ \rflts \; rs_2$
|
|
|
660 |
\item
|
|
|
661 |
If $r \neq \RZERO$ and $\nexists rs_1. r = \RALTS{rs}_1$, then $\rflts \; (r::rs) = r :: \rflts \; rs$
|
|
|
662 |
\item
|
|
|
663 |
$\rflts \; (rs @ [\RZERO]) = \rflts \; rs$
|
|
|
664 |
\item
|
|
|
665 |
$\rflts \; (rs' @ [\RALTS{rs}]) = \rflts \; rs'@rs$
|
|
|
666 |
\item
|
|
|
667 |
$\rflts \; (rs @ [\RONE]) = \rflts \; rs @ [\RONE]$
|
|
|
668 |
\item
|
|
|
669 |
If $r \neq \RZERO$ and $\nexists rs'. r = \RALTS{rs'}$ then $\rflts \; (rs @ [r])
|
|
|
670 |
= (\rflts \; rs) @ [r]$
|
|
555
|
671 |
\item
|
|
|
672 |
If $r = \RALTS{rs}$ and $r \in rs'$ then for all $r_1 \in rs.
|
|
|
673 |
r_1 \in \rflts \; rs'$.
|
|
|
674 |
\item
|
|
|
675 |
$\rflts \; (rs_a @ \RZERO :: rs_b) = \rflts \; (rs_a @ rs_b)$
|
|
543
|
676 |
\end{itemize}
|
|
|
677 |
\end{lemma}
|
|
|
678 |
\noindent
|
|
|
679 |
\begin{proof}
|
|
555
|
680 |
By induction on $rs_1$ in the first sub-lemma, and induction on $r$ in the second part,
|
|
|
681 |
and induction on $rs$, $rs'$, $rs$, $rs'$, $rs_a$ in the third, fourth, fifth, sixth and
|
|
|
682 |
last sub-lemma.
|
|
543
|
683 |
\end{proof}
|
|
555
|
684 |
|
|
554
|
685 |
\subsubsection{The $RL$ Function: Language Interpretation of $\textit{Rrexp}$s}
|
|
|
686 |
Much like the definition of $L$ on plain regular expressions, one could also
|
|
|
687 |
define the language interpretation of $\rrexp$s.
|
|
|
688 |
\begin{center}
|
|
593
|
689 |
\begin{tabular}{lcl}
|
|
|
690 |
$RL \; (\ZERO)$ & $\dn$ & $\phi$\\
|
|
|
691 |
$RL \; (\ONE)$ & $\dn$ & $\{[]\}$\\
|
|
|
692 |
$RL \; (c)$ & $\dn$ & $\{[c]\}$\\
|
|
|
693 |
$RL \; \sum rs$ & $\dn$ & $ \bigcup_{r \in rs} (RL \; r)$\\
|
|
|
694 |
$RL \; (r_1 \cdot r_2)$ & $\dn$ & $ RL \; (r_1) @ RL \; (r_2)$\\
|
|
|
695 |
$RL \; (r^*)$ & $\dn$ & $ (RL(r))^*$
|
|
|
696 |
\end{tabular}
|
|
554
|
697 |
\end{center}
|
|
|
698 |
\noindent
|
|
|
699 |
The main use of $RL$ is to establish some connections between $\rsimp{}$
|
|
|
700 |
and $\rnullable{}$:
|
|
|
701 |
\begin{lemma}
|
|
|
702 |
The following properties hold:
|
|
|
703 |
\begin{itemize}
|
|
|
704 |
\item
|
|
|
705 |
If $\rnullable{r}$, then $\rsimp{r} \neq \RZERO$.
|
|
|
706 |
\item
|
|
|
707 |
$\rnullable{r \backslash s} \quad $ if and only if $\quad \rnullable{\rderssimp{r}{s}}$.
|
|
|
708 |
\end{itemize}
|
|
|
709 |
\end{lemma}
|
|
|
710 |
\begin{proof}
|
|
|
711 |
The first part is by induction on $r$.
|
|
|
712 |
The second part is true because property
|
|
|
713 |
\[ RL \; r = RL \; (\rsimp{r})\] holds.
|
|
|
714 |
\end{proof}
|
|
593
|
715 |
|
|
554
|
716 |
\subsubsection{$\rsimp{}$ is Non-Increasing}
|
|
|
717 |
In this subsection, we prove that the function $\rsimp{}$ does not
|
|
|
718 |
make the $\llbracket \rrbracket_r$ size increase.
|
|
543
|
719 |
|
|
|
720 |
|
|
554
|
721 |
\begin{lemma}\label{rsimpSize}
|
|
|
722 |
$\llbracket \rsimp{r} \rrbracket_r \leq \llbracket r \rrbracket_r$
|
|
|
723 |
\end{lemma}
|
|
|
724 |
\subsubsection{Simplified $\textit{Rrexp}$s are Good}
|
|
|
725 |
We formalise the notion of ``good" regular expressions,
|
|
|
726 |
which means regular expressions that
|
|
|
727 |
are not fully simplified. For alternative regular expressions that means they
|
|
|
728 |
do not contain any nested alternatives like
|
|
|
729 |
\[ r_1 + (r_2 + r_3) \], un-removed $\RZERO$s like \[\RZERO + r\]
|
|
|
730 |
or duplicate elements in a children regular expression list like \[ \sum [r, r, \ldots]\]:
|
|
|
731 |
\begin{center}
|
|
|
732 |
\begin{tabular}{@{}lcl@{}}
|
|
|
733 |
$\good\; \RZERO$ & $\dn$ & $\textit{false}$\\
|
|
|
734 |
$\good\; \RONE$ & $\dn$ & $\textit{true}$\\
|
|
|
735 |
$\good\; \RCHAR{c}$ & $\dn$ & $\btrue$\\
|
|
|
736 |
$\good\; \RALTS{[]}$ & $\dn$ & $\bfalse$\\
|
|
|
737 |
$\good\; \RALTS{[r]}$ & $\dn$ & $\bfalse$\\
|
|
|
738 |
$\good\; \RALTS{r_1 :: r_2 :: rs}$ & $\dn$ &
|
|
|
739 |
$\textit{isDistinct} \; (r_1 :: r_2 :: rs) \;$\\
|
|
593
|
740 |
& & $\textit{and}\; (\forall r' \in (r_1 :: r_2 :: rs).\; \good \; r'\; \, \textit{and}\; \, \textit{nonAlt}\; r')$\\
|
|
554
|
741 |
$\good \; \RSEQ{\RZERO}{r}$ & $\dn$ & $\bfalse$\\
|
|
|
742 |
$\good \; \RSEQ{\RONE}{r}$ & $\dn$ & $\bfalse$\\
|
|
|
743 |
$\good \; \RSEQ{r}{\RZERO}$ & $\dn$ & $\bfalse$\\
|
|
|
744 |
$\good \; \RSEQ{r_1}{r_2}$ & $\dn$ & $\good \; r_1 \;\, \textit{and} \;\, \good \; r_2$\\
|
|
|
745 |
$\good \; \RSTAR{r}$ & $\dn$ & $\btrue$\\
|
|
|
746 |
\end{tabular}
|
|
|
747 |
\end{center}
|
|
|
748 |
\noindent
|
|
|
749 |
The predicate $\textit{nonAlt}$ evaluates to true when the regular expression is not an
|
|
|
750 |
alternative, and false otherwise.
|
|
|
751 |
The $\good$ property is preserved under $\rsimp_{ALTS}$, provided that
|
|
|
752 |
its non-empty argument list of expressions are all good themsleves, and $\textit{nonAlt}$,
|
|
|
753 |
and unique:
|
|
|
754 |
\begin{lemma}\label{rsimpaltsGood}
|
|
|
755 |
If $rs \neq []$ and forall $r \in rs. \textit{nonAlt} \; r$ and $\textit{isDistinct} \; rs$,
|
|
|
756 |
then $\good \; (\rsimpalts \; rs)$ if and only if forall $r \in rs. \; \good \; r$.
|
|
|
757 |
\end{lemma}
|
|
|
758 |
\noindent
|
|
|
759 |
We also note that
|
|
|
760 |
if a regular expression $r$ is good, then $\rflts$ on the singleton
|
|
|
761 |
list $[r]$ will not break goodness:
|
|
|
762 |
\begin{lemma}\label{flts2}
|
|
|
763 |
If $\good \; r$, then forall $r' \in \rflts \; [r]. \; \good \; r'$ and $\textit{nonAlt} \; r'$.
|
|
|
764 |
\end{lemma}
|
|
|
765 |
\begin{proof}
|
|
|
766 |
By an induction on $r$.
|
|
|
767 |
\end{proof}
|
|
543
|
768 |
\noindent
|
|
554
|
769 |
The other observation we make about $\rsimp{r}$ is that it never
|
|
|
770 |
comes with nested alternatives, which we describe as the $\nonnested$
|
|
|
771 |
property:
|
|
|
772 |
\begin{center}
|
|
|
773 |
\begin{tabular}{lcl}
|
|
|
774 |
$\nonnested \; \, \sum []$ & $\dn$ & $\btrue$\\
|
|
|
775 |
$\nonnested \; \, \sum ((\sum rs_1) :: rs_2)$ & $\dn$ & $\bfalse$\\
|
|
|
776 |
$\nonnested \; \, \sum (r :: rs)$ & $\dn$ & $\nonnested (\sum rs)$\\
|
|
|
777 |
$\nonnested \; \, r $ & $\dn$ & $\btrue$
|
|
|
778 |
\end{tabular}
|
|
|
779 |
\end{center}
|
|
|
780 |
\noindent
|
|
|
781 |
The $\rflts$ function
|
|
|
782 |
always opens up nested alternatives,
|
|
|
783 |
which enables $\rsimp$ to be non-nested:
|
|
|
784 |
|
|
|
785 |
\begin{lemma}\label{nonnestedRsimp}
|
|
|
786 |
$\nonnested \; (\rsimp{r})$
|
|
|
787 |
\end{lemma}
|
|
|
788 |
\begin{proof}
|
|
|
789 |
By an induction on $r$.
|
|
|
790 |
\end{proof}
|
|
|
791 |
\noindent
|
|
|
792 |
With this we could prove that a regular expressions
|
|
|
793 |
after simplification and flattening and de-duplication,
|
|
|
794 |
will not contain any alternative regular expression directly:
|
|
|
795 |
\begin{lemma}\label{nonaltFltsRd}
|
|
|
796 |
If $x \in \rdistinct{\rflts\; (\map \; \rsimp{} \; rs)}{\varnothing}$
|
|
|
797 |
then $\textit{nonAlt} \; x$.
|
|
|
798 |
\end{lemma}
|
|
|
799 |
\begin{proof}
|
|
|
800 |
By \ref{nonnestedRsimp}.
|
|
|
801 |
\end{proof}
|
|
|
802 |
\noindent
|
|
|
803 |
The other thing we know is that once $\rsimp{}$ had finished
|
|
|
804 |
processing an alternative regular expression, it will not
|
|
|
805 |
contain any $\RZERO$s, this is because all the recursive
|
|
|
806 |
calls to the simplification on the children regular expressions
|
|
|
807 |
make the children good, and $\rflts$ will not take out
|
|
|
808 |
any $\RZERO$s out of a good regular expression list,
|
|
|
809 |
and $\rdistinct{}$ will not mess with the result.
|
|
|
810 |
\begin{lemma}\label{flts3Obv}
|
|
|
811 |
The following are true:
|
|
|
812 |
\begin{itemize}
|
|
|
813 |
\item
|
|
|
814 |
If for all $r \in rs. \, \good \; r $ or $r = \RZERO$,
|
|
|
815 |
then for all $r \in \rflts\; rs. \, \good \; r$.
|
|
|
816 |
\item
|
|
|
817 |
If $x \in \rdistinct{\rflts\; (\map \; rsimp{}\; rs)}{\varnothing}$
|
|
|
818 |
and for all $y$ such that $\llbracket y \rrbracket_r$ less than
|
|
|
819 |
$\llbracket rs \rrbracket_r + 1$, either
|
|
|
820 |
$\good \; (\rsimp{y})$ or $\rsimp{y} = \RZERO$,
|
|
|
821 |
then $\good \; x$.
|
|
|
822 |
\end{itemize}
|
|
|
823 |
\end{lemma}
|
|
|
824 |
\begin{proof}
|
|
|
825 |
The first part is by induction on $rs$, where the induction
|
|
|
826 |
rule is the inductive cases for $\rflts$.
|
|
|
827 |
The second part is a corollary from the first part.
|
|
|
828 |
\end{proof}
|
|
543
|
829 |
|
|
554
|
830 |
And this leads to good structural property of $\rsimp{}$,
|
|
|
831 |
that after simplification, a regular expression is
|
|
|
832 |
either good or $\RZERO$:
|
|
|
833 |
\begin{lemma}\label{good1}
|
|
|
834 |
For any r-regular expression $r$, $\good \; \rsimp{r}$ or $\rsimp{r} = \RZERO$.
|
|
|
835 |
\end{lemma}
|
|
|
836 |
\begin{proof}
|
|
|
837 |
By an induction on $r$. The inductive measure is the size $\llbracket \rrbracket_r$.
|
|
|
838 |
Lemma \ref{rsimpSize} says that
|
|
|
839 |
$\llbracket \rsimp{r}\rrbracket_r$ is smaller than or equal to
|
|
|
840 |
$\llbracket r \rrbracket_r$.
|
|
|
841 |
Therefore, in the $r_1 \cdot r_2$ and $\sum rs$ case,
|
|
|
842 |
Inductive hypothesis applies to the children regular expressions
|
|
|
843 |
$r_1$, $r_2$, etc. The lemma \ref{flts3Obv}'s precondition is satisfied
|
|
|
844 |
by that as well.
|
|
|
845 |
The lemmas \ref{nonnestedRsimp} and \ref{nonaltFltsRd} are used
|
|
|
846 |
to ensure that goodness is preserved at the topmost level.
|
|
|
847 |
\end{proof}
|
|
|
848 |
We shall prove that any good regular expression is
|
|
|
849 |
a fixed-point for $\rsimp{}$.
|
|
|
850 |
First we prove an auxiliary lemma:
|
|
|
851 |
\begin{lemma}\label{goodaltsNonalt}
|
|
|
852 |
If $\good \; \sum rs$, then $\rflts\; rs = rs$.
|
|
|
853 |
\end{lemma}
|
|
|
854 |
\begin{proof}
|
|
|
855 |
By an induction on $\sum rs$. The inductive rules are the cases
|
|
|
856 |
for $\good$.
|
|
|
857 |
\end{proof}
|
|
|
858 |
\noindent
|
|
|
859 |
Now we are ready to prove that good regular expressions are invariant
|
|
|
860 |
of $\rsimp{}$ application:
|
|
|
861 |
\begin{lemma}\label{test}
|
|
|
862 |
If $\good \;r$ then $\rsimp{r} = r$.
|
|
|
863 |
\end{lemma}
|
|
|
864 |
\begin{proof}
|
|
|
865 |
By an induction on the inductive cases of $\good$.
|
|
|
866 |
The lemma \ref{goodaltsNonalt} is used in the alternative
|
|
|
867 |
case where 2 or more elements are present in the list.
|
|
|
868 |
\end{proof}
|
|
555
|
869 |
\noindent
|
|
|
870 |
Given below is a property involving $\rflts$, $\rdistinct{}{}$, $\rsimp{}$ and $\rsimp_{ALTS}$,
|
|
|
871 |
which requires $\ref{good1}$ to go through smoothly.
|
|
|
872 |
It says that an application of $\rsimp_{ALTS}$ can be "absorbed",
|
|
|
873 |
if it its output is concatenated with a list and then applied to $\rflts$.
|
|
|
874 |
\begin{lemma}\label{flattenRsimpalts}
|
|
|
875 |
$\rflts \; ( (\rsimp_{ALTS} \;
|
|
|
876 |
(\rdistinct{(\rflts \; (\map \; \rsimp{}\; rs))}{\varnothing})) ::
|
|
|
877 |
\map \; \rsimp{} \; rs' ) =
|
|
|
878 |
\rflts \; ( (\rdistinct{(\rflts \; (\map \; \rsimp{}\; rs))}{\varnothing}) @ (
|
|
|
879 |
\map \; \rsimp{rs'}))$
|
|
554
|
880 |
|
|
593
|
881 |
|
|
555
|
882 |
\end{lemma}
|
|
|
883 |
\begin{proof}
|
|
|
884 |
By \ref{good1}.
|
|
|
885 |
\end{proof}
|
|
|
886 |
\noindent
|
|
|
887 |
|
|
|
888 |
|
|
|
889 |
|
|
|
890 |
|
|
|
891 |
|
|
|
892 |
We are also
|
|
554
|
893 |
\subsubsection{$\rsimp$ is Idempotent}
|
|
|
894 |
The idempotency of $\rsimp$ is very useful in
|
|
|
895 |
manipulating regular expression terms into desired
|
|
|
896 |
forms so that key steps allowing further rewriting to closed forms
|
|
|
897 |
are possible.
|
|
|
898 |
\begin{lemma}\label{rsimpIdem}
|
|
593
|
899 |
$\rsimp{r} = \rsimp{\rsimp{r}}$
|
|
554
|
900 |
\end{lemma}
|
|
|
901 |
|
|
|
902 |
\begin{proof}
|
|
|
903 |
By \ref{test} and \ref{good1}.
|
|
|
904 |
\end{proof}
|
|
|
905 |
\noindent
|
|
|
906 |
This property means we do not have to repeatedly
|
|
|
907 |
apply simplification in each step, which justifies
|
|
|
908 |
our definition of $\blexersimp$.
|
|
|
909 |
|
|
532
|
910 |
|
|
554
|
911 |
On the other hand, we could repeat the same $\rsimp{}$ applications
|
|
|
912 |
on regular expressions as many times as we want, if we have at least
|
|
|
913 |
one simplification applied to it, and apply it wherever we would like to:
|
|
|
914 |
\begin{corollary}\label{headOneMoreSimp}
|
|
555
|
915 |
The following properties hold, directly from \ref{rsimpIdem}:
|
|
|
916 |
|
|
|
917 |
\begin{itemize}
|
|
|
918 |
\item
|
|
|
919 |
$\map \; \rsimp{(r :: rs)} = \map \; \rsimp{} \; (\rsimp{r} :: rs)$
|
|
|
920 |
\item
|
|
|
921 |
$\rsimp{(\RALTS{rs})} = \rsimp{(\RALTS{\map \; \rsimp{} \; rs})}$
|
|
|
922 |
\end{itemize}
|
|
554
|
923 |
\end{corollary}
|
|
|
924 |
\noindent
|
|
|
925 |
This will be useful in later closed form proof's rewriting steps.
|
|
|
926 |
Similarly, we point out the following useful facts below:
|
|
|
927 |
\begin{lemma}
|
|
|
928 |
The following equalities hold if $r = \rsimp{r'}$ for some $r'$:
|
|
|
929 |
\begin{itemize}
|
|
|
930 |
\item
|
|
|
931 |
If $r = \sum rs$ then $\rsimpalts \; rs = \sum rs$.
|
|
|
932 |
\item
|
|
|
933 |
If $r = \sum rs$ then $\rdistinct{rs}{\varnothing} = rs$.
|
|
|
934 |
\item
|
|
|
935 |
$\rsimpalts \; (\rdistinct{\rflts \; [r]}{\varnothing}) = r$.
|
|
|
936 |
\end{itemize}
|
|
|
937 |
\end{lemma}
|
|
|
938 |
\begin{proof}
|
|
|
939 |
By application of \ref{rsimpIdem} and \ref{good1}.
|
|
|
940 |
\end{proof}
|
|
|
941 |
|
|
|
942 |
\noindent
|
|
|
943 |
With the idempotency of $\rsimp{}$ and its corollaries,
|
|
|
944 |
we can start proving some key equalities leading to the
|
|
|
945 |
closed forms.
|
|
|
946 |
Now presented are a few equivalent terms under $\rsimp{}$.
|
|
|
947 |
We use $r_1 \sequal r_2 $ here to denote $\rsimp{r_1} = \rsimp{r_2}$.
|
|
|
948 |
\begin{lemma}
|
|
593
|
949 |
\begin{itemize}
|
|
|
950 |
The following equivalence hold:
|
|
554
|
951 |
\item
|
|
|
952 |
$\rsimpalts \; (\RZERO :: rs) \sequal \rsimpalts\; rs$
|
|
|
953 |
\item
|
|
|
954 |
$\rsimpalts \; rs \sequal \rsimpalts (\map \; \rsimp{} \; rs)$
|
|
|
955 |
\item
|
|
|
956 |
$\RALTS{\RALTS{rs}} \sequal \RALTS{rs}$
|
|
555
|
957 |
\item
|
|
|
958 |
$\sum ((\sum rs_a) :: rs_b) \sequal \sum rs_a @ rs_b$
|
|
|
959 |
\item
|
|
|
960 |
$\RALTS{rs} = \RALTS{\map \; \rsimp{} \; rs}$
|
|
554
|
961 |
\end{itemize}
|
|
|
962 |
\end{lemma}
|
|
555
|
963 |
\begin{proof}
|
|
|
964 |
By induction on the lists involved.
|
|
|
965 |
\end{proof}
|
|
|
966 |
\noindent
|
|
|
967 |
Similarly,
|
|
|
968 |
we introduce the equality for $\sum$ when certain child regular expressions
|
|
|
969 |
are $\sum$ themselves:
|
|
|
970 |
\begin{lemma}\label{simpFlatten3}
|
|
|
971 |
One can flatten the inside $\sum$ of a $\sum$ if it is being
|
|
|
972 |
simplified. Concretely,
|
|
|
973 |
\begin{itemize}
|
|
|
974 |
\item
|
|
|
975 |
If for all $r \in rs, rs', rs''$, we have $\good \; r $
|
|
|
976 |
or $r = \RZERO$, then $\sum (rs' @ rs @ rs'') \sequal
|
|
|
977 |
\sum (rs' @ [\sum rs] @ rs'')$ holds. As a corollary,
|
|
|
978 |
\item
|
|
|
979 |
$\sum (rs' @ [\sum rs] @ rs'') \sequal \sum (rs' @ rs @ rs'')$
|
|
|
980 |
\end{itemize}
|
|
|
981 |
\end{lemma}
|
|
|
982 |
\begin{proof}
|
|
|
983 |
By rewriting steps involving the use of \ref{test} and \ref{rdistinctConcatGeneral}.
|
|
|
984 |
The second sub-lemma is a corollary of the previous.
|
|
|
985 |
\end{proof}
|
|
|
986 |
%Rewriting steps not put in--too long and complicated-------------------------------
|
|
|
987 |
\begin{comment}
|
|
|
988 |
\begin{center}
|
|
|
989 |
$\rsimp{\sum (rs' @ rs @ rs'')} \stackrel{def of bsimp}{=}$ \\
|
|
|
990 |
$\rsimpalts \; (\rdistinct{\rflts \; ((\map \; \rsimp{}\; rs') @ (\map \; \rsimp{} \; rs ) @ (\map \; \rsimp{} \; rs''))}{\varnothing})$ \\
|
|
|
991 |
$\stackrel{by \ref{test}}{=}
|
|
|
992 |
\rsimpalts \; (\rdistinct{(\rflts \; rs' @ \rflts \; rs @ \rflts \; rs'')}{
|
|
|
993 |
\varnothing})$\\
|
|
|
994 |
$\stackrel{by \ref{rdistinctConcatGeneral}}{=}
|
|
|
995 |
\rsimpalts \; (\rdistinct{\rflts \; rs'}{\varnothing} @ \rdistinct{(
|
|
|
996 |
\rflts\; rs @ \rflts \; rs'')}{\rflts \; rs'})$\\
|
|
593
|
997 |
|
|
555
|
998 |
\end{center}
|
|
|
999 |
\end{comment}
|
|
|
1000 |
%Rewriting steps not put in--too long and complicated-------------------------------
|
|
554
|
1001 |
\noindent
|
|
|
1002 |
We need more equalities like the above to enable a closed form,
|
|
|
1003 |
but to proceed we need to introduce two rewrite relations,
|
|
|
1004 |
to make things smoother.
|
|
557
|
1005 |
\subsubsection{The rewrite relation $\hrewrite$ , $\scfrewrites$ , $\frewrite$ and $\grewrite$}
|
|
554
|
1006 |
Insired by the success we had in the correctness proof
|
|
|
1007 |
in \ref{Bitcoded2}, where we invented
|
|
555
|
1008 |
a term rewriting system to capture the similarity between terms,
|
|
|
1009 |
we follow suit here defining simplification
|
|
|
1010 |
steps as rewriting steps. This allows capturing
|
|
|
1011 |
similarities between terms that would be otherwise
|
|
|
1012 |
hard to express.
|
|
|
1013 |
|
|
557
|
1014 |
We use $\hrewrite$ for one-step atomic rewrite of
|
|
|
1015 |
regular expression simplification,
|
|
555
|
1016 |
$\frewrite$ for rewrite of list of regular expressions that
|
|
|
1017 |
include all operations carried out in $\rflts$, and $\grewrite$ for
|
|
|
1018 |
rewriting a list of regular expressions possible in both $\rflts$ and $\rdistinct{}{}$.
|
|
|
1019 |
Their reflexive transitive closures are used to denote zero or many steps,
|
|
|
1020 |
as was the case in the previous chapter.
|
|
554
|
1021 |
The presentation will be more concise than that in \ref{Bitcoded2}.
|
|
|
1022 |
To differentiate between the rewriting steps for annotated regular expressions
|
|
|
1023 |
and $\rrexp$s, we add characters $h$ and $g$ below the squig arrow symbol
|
|
|
1024 |
to mean atomic simplification transitions
|
|
|
1025 |
of $\rrexp$s and $\rrexp$ lists, respectively.
|
|
|
1026 |
|
|
555
|
1027 |
|
|
|
1028 |
|
|
593
|
1029 |
List of one-step rewrite rules for $\rrexp$ ($\hrewrite$):
|
|
555
|
1030 |
|
|
|
1031 |
|
|
554
|
1032 |
\begin{center}
|
|
593
|
1033 |
\begin{mathpar}
|
|
|
1034 |
\inferrule[RSEQ0L]{}{\RZERO \cdot r_2 \hrewrite \RZERO\\}
|
|
555
|
1035 |
|
|
593
|
1036 |
\inferrule[RSEQ0R]{}{r_1 \cdot \RZERO \hrewrite \RZERO\\}
|
|
555
|
1037 |
|
|
593
|
1038 |
\inferrule[RSEQ1]{}{(\RONE \cdot r) \hrewrite r\\}\\
|
|
555
|
1039 |
|
|
593
|
1040 |
\inferrule[RSEQL]{ r_1 \hrewrite r_2}{r_1 \cdot r_3 \hrewrite r_2 \cdot r_3\\}
|
|
|
1041 |
|
|
|
1042 |
\inferrule[RSEQR]{ r_3 \hrewrite r_4}{r_1 \cdot r_3 \hrewrite r_1 \cdot r_4\\}\\
|
|
555
|
1043 |
|
|
593
|
1044 |
\inferrule[RALTSChild]{r \hrewrite r'}{\sum (rs_1 @ [r] @ rs_2) \hrewrite \sum (rs_1 @ [r'] @ rs_2)\\}
|
|
555
|
1045 |
|
|
593
|
1046 |
\inferrule[RALTS0]{}{\sum (rs_a @ [\RZERO] @ rs_b) \hrewrite \sum (rs_a @ rs_b)}
|
|
555
|
1047 |
|
|
593
|
1048 |
\inferrule[RALTSNested]{}{\sum (rs_a @ [\sum rs_1] @ rs_b) \hrewrite \sum (rs_a @ rs_1 @ rs_b)}
|
|
555
|
1049 |
|
|
593
|
1050 |
\inferrule[RALTSNil]{}{ \sum [] \hrewrite \RZERO\\}
|
|
555
|
1051 |
|
|
593
|
1052 |
\inferrule[RALTSSingle]{}{ \sum [r] \hrewrite r\\}
|
|
555
|
1053 |
|
|
593
|
1054 |
\inferrule[RALTSDelete]{\\ r_1 = r_2}{\sum rs_a @ [r_1] @ rs_b @ [r_2] @ rsc \hrewrite \sum rs_a @ [r_1] @ rs_b @ rs_c}
|
|
555
|
1055 |
|
|
593
|
1056 |
\end{mathpar}
|
|
555
|
1057 |
\end{center}
|
|
554
|
1058 |
|
|
557
|
1059 |
|
|
593
|
1060 |
List of rewrite rules for a list of regular expressions,
|
|
|
1061 |
where each element can rewrite in many steps to the other (scf stands for
|
|
|
1062 |
li\emph{s}t \emph{c}losed \emph{f}orm). This relation is similar to the
|
|
|
1063 |
$\stackrel{s*}{\rightsquigarrow}$ for annotated regular expressions.
|
|
557
|
1064 |
|
|
|
1065 |
\begin{center}
|
|
593
|
1066 |
\begin{mathpar}
|
|
|
1067 |
\inferrule{}{[] \scfrewrites [] }
|
|
|
1068 |
\inferrule{r \hrewrites r' \\ rs \scfrewrites rs'}{r :: rs \scfrewrites r' :: rs'}
|
|
|
1069 |
\end{mathpar}
|
|
557
|
1070 |
\end{center}
|
|
555
|
1071 |
%frewrite
|
|
593
|
1072 |
List of one-step rewrite rules for flattening
|
|
|
1073 |
a list of regular expressions($\frewrite$):
|
|
555
|
1074 |
\begin{center}
|
|
593
|
1075 |
\begin{mathpar}
|
|
|
1076 |
\inferrule{}{\RZERO :: rs \frewrite rs \\}
|
|
555
|
1077 |
|
|
593
|
1078 |
\inferrule{}{(\sum rs) :: rs_a \frewrite rs @ rs_a \\}
|
|
555
|
1079 |
|
|
593
|
1080 |
\inferrule{rs_1 \frewrite rs_2}{r :: rs_1 \frewrite r :: rs_2}
|
|
|
1081 |
\end{mathpar}
|
|
555
|
1082 |
\end{center}
|
|
|
1083 |
|
|
593
|
1084 |
Lists of one-step rewrite rules for flattening and de-duplicating
|
|
|
1085 |
a list of regular expressions ($\grewrite$):
|
|
555
|
1086 |
\begin{center}
|
|
593
|
1087 |
\begin{mathpar}
|
|
|
1088 |
\inferrule{}{\RZERO :: rs \grewrite rs \\}
|
|
532
|
1089 |
|
|
593
|
1090 |
\inferrule{}{(\sum rs) :: rs_a \grewrite rs @ rs_a \\}
|
|
555
|
1091 |
|
|
593
|
1092 |
\inferrule{rs_1 \grewrite rs_2}{r :: rs_1 \grewrite r :: rs_2}
|
|
555
|
1093 |
|
|
593
|
1094 |
\inferrule[dB]{}{rs_a @ [a] @ rs_b @[a] @ rs_c \grewrite rs_a @ [a] @ rsb @ rsc}
|
|
|
1095 |
\end{mathpar}
|
|
555
|
1096 |
\end{center}
|
|
|
1097 |
|
|
|
1098 |
\noindent
|
|
|
1099 |
The reason why we take the trouble of defining
|
|
|
1100 |
two separate list rewriting definitions $\frewrite$ and $\grewrite$
|
|
557
|
1101 |
is to separate the two stages of simplification: flattening and de-duplicating.
|
|
|
1102 |
Sometimes $\grewrites$ is slightly too powerful
|
|
|
1103 |
so we would rather use $\frewrites$ which makes certain rewriting steps
|
|
|
1104 |
more straightforward to prove.
|
|
556
|
1105 |
For example, when proving the closed-form for the alternative regular expression,
|
|
|
1106 |
one of the rewriting steps would be:
|
|
|
1107 |
\begin{lemma}
|
|
557
|
1108 |
$\sum (\rDistinct \;\; (\map \; (\_ \backslash x) \; (\rflts \; rs)) \;\; \varnothing) \sequal
|
|
593
|
1109 |
\sum (\rDistinct \;\; (\rflts \; (\map \; (\_ \backslash x) \; rs)) \;\; \varnothing)
|
|
|
1110 |
$
|
|
556
|
1111 |
\end{lemma}
|
|
|
1112 |
\noindent
|
|
|
1113 |
Proving this is by first showing
|
|
557
|
1114 |
\begin{lemma}\label{earlyLaterDerFrewrites}
|
|
556
|
1115 |
$\map \; (\_ \backslash x) \; (\rflts \; rs) \frewrites
|
|
557
|
1116 |
\rflts \; (\map \; (\_ \backslash x) \; rs)$
|
|
556
|
1117 |
\end{lemma}
|
|
|
1118 |
\noindent
|
|
|
1119 |
and then using lemma
|
|
|
1120 |
\begin{lemma}\label{frewritesSimpeq}
|
|
|
1121 |
If $rs_1 \frewrites rs_2 $, then $\sum (\rDistinct \; rs_1 \; \varnothing) \sequal
|
|
557
|
1122 |
\sum (\rDistinct \; rs_2 \; \varnothing)$.
|
|
556
|
1123 |
\end{lemma}
|
|
557
|
1124 |
\noindent
|
|
|
1125 |
is a piece of cake.
|
|
|
1126 |
But this trick will not work for $\grewrites$.
|
|
|
1127 |
For example, a rewriting step in proving
|
|
|
1128 |
closed forms is:
|
|
|
1129 |
\begin{center}
|
|
593
|
1130 |
$\rsimp{(\rsimpalts \; (\map \; (\_ \backslash x) \; (\rdistinct{(\rflts \; (\map \; (\rsimp{} \; \circ \; (\lambda r. \rderssimp{r}{xs}))))}{\varnothing})))}$\\
|
|
|
1131 |
$=$ \\
|
|
|
1132 |
$\rsimp{(\rsimpalts \; (\rdistinct{(\map \; (\_ \backslash x) \; (\rflts \; (\map \; (\rsimp{} \; \circ \; (\lambda r. \rderssimp{r}{xs})))) ) }{\varnothing}))} $
|
|
|
1133 |
\noindent
|
|
557
|
1134 |
\end{center}
|
|
|
1135 |
For this one would hope to have a rewriting relation between the two lists involved,
|
|
|
1136 |
similar to \ref{earlyLaterDerFrewrites}. However, it turns out that
|
|
556
|
1137 |
\begin{center}
|
|
593
|
1138 |
$\map \; (\_ \backslash x) \; (\rDistinct \; rs \; rset) \grewrites \rDistinct \; (\map \;
|
|
|
1139 |
(\_ \backslash x) \; rs) \; ( rset \backslash x)$
|
|
556
|
1140 |
\end{center}
|
|
|
1141 |
\noindent
|
|
557
|
1142 |
does $\mathbf{not}$ hold in general.
|
|
|
1143 |
For this rewriting step we will introduce some slightly more cumbersome
|
|
|
1144 |
proof technique in later sections.
|
|
|
1145 |
The point is that $\frewrite$
|
|
|
1146 |
allows us to prove equivalence in a straightforward two-step method that is
|
|
|
1147 |
not possible for $\grewrite$, thereby reducing the complexity of the entire proof.
|
|
555
|
1148 |
|
|
556
|
1149 |
|
|
557
|
1150 |
\subsubsection{Terms That Can Be Rewritten Using $\hrewrites$, $\grewrites$, and $\frewrites$}
|
|
|
1151 |
We present in the below lemma a few pairs of terms that are rewritable via
|
|
|
1152 |
$\grewrites$:
|
|
|
1153 |
\begin{lemma}\label{gstarRdistinctGeneral}
|
|
|
1154 |
\begin{itemize}
|
|
|
1155 |
\item
|
|
|
1156 |
$rs_1 @ rs \grewrites rs_1 @ (\rDistinct \; rs \; rs_1)$
|
|
|
1157 |
\item
|
|
|
1158 |
$rs \grewrites \rDistinct \; rs \; \varnothing$
|
|
|
1159 |
\item
|
|
|
1160 |
$rs_a @ (\rDistinct \; rs \; rs_a) \grewrites rs_a @ (\rDistinct \;
|
|
|
1161 |
rs \; (\{\RZERO\} \cup rs_a))$
|
|
|
1162 |
\item
|
|
|
1163 |
$rs \;\; @ \;\; \rDistinct \; rs_a \; rset \grewrites rs @ \rDistinct \; rs_a \;
|
|
|
1164 |
(rest \cup rs)$
|
|
|
1165 |
|
|
|
1166 |
\end{itemize}
|
|
|
1167 |
\end{lemma}
|
|
|
1168 |
\noindent
|
|
|
1169 |
If a pair of terms $rs_1, rs_2$ are rewritable via $\grewrites$ to each other,
|
|
|
1170 |
then they are equivalent under $\rsimp{}$:
|
|
|
1171 |
\begin{lemma}\label{grewritesSimpalts}
|
|
|
1172 |
If $rs_1 \grewrites rs_2$, then
|
|
|
1173 |
we have the following equivalence hold:
|
|
|
1174 |
\begin{itemize}
|
|
|
1175 |
\item
|
|
|
1176 |
$\sum rs_1 \sequal \sum rs_2$
|
|
|
1177 |
\item
|
|
|
1178 |
$\rsimpalts \; rs_1 \sequal \rsimpalts \; rs_2$
|
|
|
1179 |
\end{itemize}
|
|
|
1180 |
\end{lemma}
|
|
|
1181 |
\noindent
|
|
|
1182 |
Here are a few connecting lemmas showing that
|
|
|
1183 |
if a list of regular expressions can be rewritten using $\grewrites$ or $\frewrites $ or
|
|
|
1184 |
$\scfrewrites$,
|
|
|
1185 |
then an alternative constructor taking the list can also be rewritten using $\hrewrites$:
|
|
|
1186 |
\begin{lemma}
|
|
|
1187 |
\begin{itemize}
|
|
|
1188 |
\item
|
|
|
1189 |
If $rs \grewrites rs'$ then $\sum rs \hrewrites \sum rs'$.
|
|
|
1190 |
\item
|
|
|
1191 |
If $rs \grewrites rs'$ then $\sum rs \hrewrites \rsimpalts \; rs'$
|
|
|
1192 |
\item
|
|
|
1193 |
If $rs_1 \scfrewrites rs_2$ then $\sum (rs @ rs_1) \hrewrites \sum (rs @ rs_2)$
|
|
|
1194 |
\item
|
|
|
1195 |
If $rs_1 \scfrewrites rs_2$ then $\sum rs_1 \hrewrites \sum rs_2$
|
|
|
1196 |
|
|
|
1197 |
\end{itemize}
|
|
|
1198 |
\end{lemma}
|
|
|
1199 |
\noindent
|
|
|
1200 |
Here comes the meat of the proof,
|
|
|
1201 |
which says that once two lists are rewritable to each other,
|
|
|
1202 |
then they are equivalent under $\rsimp{}$:
|
|
|
1203 |
\begin{lemma}
|
|
|
1204 |
If $r_1 \hrewrites r_2$ then $r_1 \sequal r_2$.
|
|
|
1205 |
\end{lemma}
|
|
|
1206 |
|
|
|
1207 |
\noindent
|
|
|
1208 |
And similar to \ref{Bitcoded2} one can preserve rewritability after taking derivative
|
|
|
1209 |
of two regular expressions on both sides:
|
|
|
1210 |
\begin{lemma}\label{interleave}
|
|
|
1211 |
If $r \hrewrites r' $ then $\rder{c}{r} \hrewrites \rder{c}{r'}$
|
|
|
1212 |
\end{lemma}
|
|
|
1213 |
\noindent
|
|
|
1214 |
This allows proving more $\mathbf{rsimp}$-equivalent terms, involving $\backslash_r$ now.
|
|
|
1215 |
\begin{lemma}\label{insideSimpRemoval}
|
|
|
1216 |
$\rsimp{\rder{c}{\rsimp{r}}} = \rsimp{\rder{c}{r}} $
|
|
|
1217 |
\end{lemma}
|
|
|
1218 |
\noindent
|
|
|
1219 |
\begin{proof}
|
|
|
1220 |
By \ref{interleave} and \ref{rsimpIdem}.
|
|
|
1221 |
\end{proof}
|
|
|
1222 |
\noindent
|
|
|
1223 |
And this unlocks more equivalent terms:
|
|
|
1224 |
\begin{lemma}\label{Simpders}
|
|
|
1225 |
As corollaries of \ref{insideSimpRemoval}, we have
|
|
|
1226 |
\begin{itemize}
|
|
|
1227 |
\item
|
|
|
1228 |
If $s \neq []$ then $\rderssimp{r}{s} = \rsimp{(\rders \; r \; s)}$.
|
|
|
1229 |
\item
|
|
|
1230 |
$\rsimpalts \; (\map \; (\_ \backslash_r x) \;
|
|
593
|
1231 |
(\rdistinct{rs}{\varnothing})) \sequal
|
|
|
1232 |
\rsimpalts \; (\rDistinct \;
|
|
|
1233 |
(\map \; (\_ \backslash_r x) rs) \;\varnothing )$
|
|
|
1234 |
\end{itemize}
|
|
|
1235 |
\end{lemma}
|
|
557
|
1236 |
\noindent
|
|
|
1237 |
|
|
|
1238 |
Finally,
|
|
|
1239 |
together with
|
|
|
1240 |
\begin{lemma}\label{rderRsimpAltsCommute}
|
|
|
1241 |
$\rder{x}{(\rsimpalts \; rs)} = \rsimpalts \; (\map \; (\rder{x}{\_}) \; rs)$
|
|
|
1242 |
\end{lemma}
|
|
|
1243 |
\noindent
|
|
|
1244 |
this leads to the first closed form--
|
|
|
1245 |
\begin{lemma}\label{altsClosedForm}
|
|
593
|
1246 |
\begin{center}
|
|
|
1247 |
$\rderssimp{(\sum rs)}{s} \sequal
|
|
|
1248 |
\sum \; (\map \; (\rderssimp{\_}{s}) \; rs)$
|
|
|
1249 |
\end{center}
|
|
557
|
1250 |
\end{lemma}
|
|
593
|
1251 |
|
|
556
|
1252 |
\noindent
|
|
557
|
1253 |
\begin{proof}
|
|
|
1254 |
By a reverse induction on the string $s$.
|
|
|
1255 |
One rewriting step, as we mentioned earlier,
|
|
|
1256 |
involves
|
|
|
1257 |
\begin{center}
|
|
|
1258 |
$\rsimpalts \; (\map \; (\_ \backslash x) \;
|
|
|
1259 |
(\rdistinct{(\rflts \; (\map \; (\rsimp{} \; \circ \;
|
|
|
1260 |
(\lambda r. \rderssimp{r}{xs}))))}{\varnothing}))
|
|
|
1261 |
\sequal
|
|
|
1262 |
\rsimpalts \; (\rdistinct{(\map \; (\_ \backslash x) \;
|
|
593
|
1263 |
(\rflts \; (\map \; (\rsimp{} \; \circ \;
|
|
557
|
1264 |
(\lambda r. \rderssimp{r}{xs})))) ) }{\varnothing}) $.
|
|
|
1265 |
\end{center}
|
|
|
1266 |
This can be proven by a combination of
|
|
|
1267 |
\ref{grewritesSimpalts}, \ref{gstarRdistinctGeneral}, \ref{rderRsimpAltsCommute}, and
|
|
|
1268 |
\ref{insideSimpRemoval}.
|
|
|
1269 |
\end{proof}
|
|
|
1270 |
\noindent
|
|
|
1271 |
This closed form has a variant which can be more convenient in later proofs:
|
|
559
|
1272 |
\begin{corollary}{altsClosedForm1}
|
|
557
|
1273 |
If $s \neq []$ then
|
|
|
1274 |
$\rderssimp \; (\sum \; rs) \; s =
|
|
|
1275 |
\rsimp{(\sum \; (\map \; \rderssimp{\_}{s} \; rs))}$.
|
|
|
1276 |
\end{corollary}
|
|
|
1277 |
\noindent
|
|
|
1278 |
The harder closed forms are the sequence and star ones.
|
|
|
1279 |
Before we go on to obtain them, some preliminary definitions
|
|
|
1280 |
are needed to make proof statements concise.
|
|
556
|
1281 |
|
|
558
|
1282 |
\section{"Closed Forms" of Sequence Regular Expressions}
|
|
|
1283 |
The problem of obataining a closed-form for sequence regular expression
|
|
|
1284 |
is constructing $(r_1 \cdot r_2) \backslash_r s$
|
|
|
1285 |
if we are only allowed to use a combination of $r_1 \backslash s''$
|
|
|
1286 |
and $r_2 \backslash s''$ , where $s''$ is from $s$.
|
|
|
1287 |
First let's look at a series of derivatives steps on a sequence
|
|
|
1288 |
regular expression, assuming that each time the first
|
|
|
1289 |
component of the sequence is always nullable):
|
|
557
|
1290 |
\begin{center}
|
|
558
|
1291 |
|
|
593
|
1292 |
$r_1 \cdot r_2 \quad \longrightarrow_{\backslash c} \quad r_1 \backslash c \cdot r_2 + r_2 \backslash c \quad \longrightarrow_{\backslash c'} \quad (r_1 \backslash cc' \cdot r_2 + r_2 \backslash c') + r_2 \backslash cc' \longrightarrow_{\backslash c''} \quad$\\
|
|
|
1293 |
$((r_1 \backslash cc'c'' \cdot r_2 + r_2 \backslash c'') + r_2 \backslash c'c'') + r_2 \backslash cc'c'' \longrightarrow_{\backslash c''} \quad
|
|
|
1294 |
\ldots$
|
|
558
|
1295 |
|
|
557
|
1296 |
\end{center}
|
|
558
|
1297 |
Roughly speaking $r_1 \cdot r_2 \backslash s$ can be expresssed as
|
|
|
1298 |
a giant alternative taking a list of terms
|
|
|
1299 |
$[r_1 \backslash_r s \cdot r_2, r_2 \backslash_r s'', r_2 \backslash_r s_1'', \ldots]$,
|
|
|
1300 |
where the head of the list is always the term
|
|
|
1301 |
representing a match involving only $r_1$, and the tail of the list consisting of
|
|
|
1302 |
terms of the shape $r_2 \backslash_r s''$, $s''$ being a suffix of $s$.
|
|
557
|
1303 |
This intuition is also echoed by IndianPaper, where they gave
|
|
|
1304 |
a pencil-and-paper derivation of $(r_1 \cdot r_2)\backslash s$:
|
|
532
|
1305 |
\begin{center}
|
|
558
|
1306 |
\begin{tabular}{c}
|
|
593
|
1307 |
$(r_1 \cdot r_2) \backslash_r (c_1 :: c_2 :: \ldots c_n) \myequiv$\\
|
|
|
1308 |
\rule{0pt}{3ex} $((r_1 \backslash_r c_1) \cdot r_2 + (\delta\; (\rnullable \; r_1) \; r_2 \backslash_r c_1)) \backslash_r (c_2 :: \ldots c_n)
|
|
|
1309 |
\myequiv$\\
|
|
|
1310 |
\rule{0pt}{3ex} $((r_1 \backslash_r c_1c_2 \cdot r_2 + (\delta \; (\rnullable \; r_1) \; r_2 \backslash_r c_1c_2))
|
|
|
1311 |
+ (\delta \ (\rnullable \; r_1 \backslash_r c)\; r_2 \backslash_r c_2)) \backslash_r (c_3 \ldots c_n)
|
|
|
1312 |
$
|
|
558
|
1313 |
\end{tabular}
|
|
557
|
1314 |
\end{center}
|
|
|
1315 |
\noindent
|
|
558
|
1316 |
The equality in above should be interpretated
|
|
|
1317 |
as language equivalence.
|
|
|
1318 |
The $\delta$ function works similarly to that of
|
|
|
1319 |
a Kronecker delta function:
|
|
|
1320 |
\[ \delta \; b\; r\]
|
|
|
1321 |
will produce $r$
|
|
|
1322 |
if $b$ evaluates to true,
|
|
|
1323 |
and $\RZERO$ otherwise.
|
|
|
1324 |
Note that their formulation
|
|
|
1325 |
\[
|
|
|
1326 |
((r_1 \backslash_r \, c_1c_2 \cdot r_2 + (\delta \; (\rnullable) \; r_1, r_2 \backslash_r c_1c_2)
|
|
|
1327 |
+ (\delta \; (\rnullable \; r_1 \backslash_r c)\; r_2 \backslash_r c_2)
|
|
|
1328 |
\]
|
|
|
1329 |
does not faithfully
|
|
|
1330 |
represent what the intermediate derivatives would actually look like
|
|
|
1331 |
when one or more intermediate results $r_1 \backslash s' \cdot r_2$ are not
|
|
|
1332 |
nullable in the head of the sequence.
|
|
|
1333 |
For example, when $r_1$ and $r_1 \backslash_r c_1$ are not nullable,
|
|
|
1334 |
the regular expression would not look like
|
|
|
1335 |
\[
|
|
|
1336 |
(r_1 \backslash_r c_1c_2 + \RZERO ) + \RZERO,
|
|
|
1337 |
\]
|
|
|
1338 |
but actually $r_1 \backslash_r c_1c_2$, the redundant $\RZERO$s will not be created in the
|
|
|
1339 |
first place.
|
|
|
1340 |
In a closed-form one would want to take into account this
|
|
|
1341 |
and generate the list of
|
|
|
1342 |
regular expressions $r_2 \backslash_r s''$ with
|
|
|
1343 |
string pairs $(s', s'')$ where $s'@s'' = s$ and
|
|
|
1344 |
$r_1 \backslash s'$ nullable.
|
|
|
1345 |
We denote the list consisting of such
|
|
|
1346 |
strings $s''$ as $\vsuf{s}{r_1}$.
|
|
|
1347 |
|
|
|
1348 |
The function $\vsuf{\_}{\_}$ is defined recursively on the structure of the string:
|
|
|
1349 |
\begin{center}
|
|
593
|
1350 |
\begin{tabular}{lcl}
|
|
|
1351 |
$\vsuf{[]}{\_} $ & $=$ & $[]$\\
|
|
|
1352 |
$\vsuf{c::cs}{r_1}$ & $ =$ & $ \textit{if} (\rnullable{r_1}) \textit{then} \; (\vsuf{cs}{(\rder{c}{r_1})}) @ [c :: cs]$\\
|
|
|
1353 |
&& $\textit{else} \; (\vsuf{cs}{(\rder{c}{r_1}) }) $
|
|
|
1354 |
\end{tabular}
|
|
558
|
1355 |
\end{center}
|
|
|
1356 |
\noindent
|
|
|
1357 |
The list is sorted in the order $r_2\backslash s''$
|
|
|
1358 |
appears in $(r_1\cdot r_2)\backslash s$.
|
|
|
1359 |
In essence, $\vsuf{\_}{\_}$ is doing a
|
|
|
1360 |
"virtual derivative" of $r_1 \cdot r_2$, but instead of producing
|
|
|
1361 |
the entire result $(r_1 \cdot r_2) \backslash s$,
|
|
|
1362 |
it only stores all the strings $s''$ such that $r_2 \backslash s''$
|
|
|
1363 |
are occurring terms in $(r_1\cdot r_2)\backslash s$.
|
|
|
1364 |
|
|
|
1365 |
To make the closed form representation
|
|
|
1366 |
more straightforward,
|
|
|
1367 |
the flattetning function $\sflat{\_}$ is used to enable the transformation from
|
|
557
|
1368 |
a left-associative nested sequence of alternatives into
|
|
|
1369 |
a flattened list:
|
|
558
|
1370 |
\[
|
|
593
|
1371 |
\sum [r_1, r_2, r_3, \ldots] \stackrel{\sflat{\_}}{\rightarrow}
|
|
|
1372 |
(\ldots ((r_1 + r_2) + r_3) + \ldots)
|
|
558
|
1373 |
\]
|
|
|
1374 |
\noindent
|
|
|
1375 |
The definitions $\sflat{\_}$, $\sflataux{\_}$ are given below.
|
|
593
|
1376 |
\begin{center}
|
|
|
1377 |
\begin{tabular}{ccc}
|
|
|
1378 |
$\sflataux{\AALTS{ }{r :: rs}}$ & $=$ & $\sflataux{r} @ rs$\\
|
|
|
1379 |
$\sflataux{\AALTS{ }{[]}}$ & $ = $ & $ []$\\
|
|
|
1380 |
$\sflataux r$ & $=$ & $ [r]$
|
|
|
1381 |
\end{tabular}
|
|
532
|
1382 |
\end{center}
|
|
|
1383 |
|
|
593
|
1384 |
\begin{center}
|
|
|
1385 |
\begin{tabular}{ccc}
|
|
|
1386 |
$\sflat{(\sum r :: rs)}$ & $=$ & $\sum (\sflataux{r} @ rs)$\\
|
|
|
1387 |
$\sflat{\sum []}$ & $ = $ & $ \sum []$\\
|
|
|
1388 |
$\sflat r$ & $=$ & $ r$
|
|
|
1389 |
\end{tabular}
|
|
557
|
1390 |
\end{center}
|
|
558
|
1391 |
\noindent
|
|
576
|
1392 |
$\sflataux{\_}$ breaks up nested alternative regular expressions
|
|
557
|
1393 |
of the $(\ldots((r_1 + r_2) + r_3) + \ldots )$(left-associated) shape
|
|
558
|
1394 |
into a "balanced" list: $\AALTS{\_}{[r_1,\, r_2 ,\, r_3, \ldots]}$.
|
|
557
|
1395 |
It will return the singleton list $[r]$ otherwise.
|
|
|
1396 |
$\sflat{\_}$ works the same as $\sflataux{\_}$, except that it keeps
|
|
|
1397 |
the output type a regular expression, not a list.
|
|
558
|
1398 |
$\sflataux{\_}$ and $\sflat{\_}$ are only recursive on the
|
|
|
1399 |
first element of the list.
|
|
|
1400 |
|
|
|
1401 |
With $\sflataux{}$ a preliminary to the closed form can be stated,
|
|
|
1402 |
where the derivative of $r_1 \cdot r_2 \backslash s$ can be
|
|
|
1403 |
flattened into a list whose head and tail meet the description
|
|
|
1404 |
we gave earlier.
|
|
|
1405 |
\begin{lemma}\label{seqSfau0}
|
|
|
1406 |
$\sflataux{\rders{(r_1 \cdot r_2) \backslash s }} = (r_1 \backslash_r s) \cdot r_2
|
|
|
1407 |
:: (\map \; (r_2 \backslash_r \_) \; (\textit{Suffix} \; s \; r1))$
|
|
|
1408 |
\end{lemma}
|
|
|
1409 |
\begin{proof}
|
|
|
1410 |
By an induction on the string $s$, where the inductive cases
|
|
|
1411 |
are split as $[]$ and $xs @ [x]$.
|
|
|
1412 |
Note the key identify holds:
|
|
|
1413 |
\[
|
|
|
1414 |
\map \; (r_2 \backslash_r \_) \; (\vsuf{[x]}{(r_1 \backslash_r xs)}) \;\; @ \;\;
|
|
|
1415 |
\map \; (\_ \backslash_r x) \; (\map \; (r_2 \backslash \_) \; (\vsuf{xs}{r_1}))
|
|
|
1416 |
\]
|
|
593
|
1417 |
=
|
|
558
|
1418 |
\[
|
|
|
1419 |
\map \; (r_2 \backslash_r \_) \; (\vsuf{xs @ [x]}{r_1})
|
|
|
1420 |
\]
|
|
|
1421 |
This enables the inductive case to go through.
|
|
|
1422 |
\end{proof}
|
|
|
1423 |
\noindent
|
|
|
1424 |
Note that this lemma does $\mathbf{not}$ depend on any
|
|
|
1425 |
specific definitions we used,
|
|
|
1426 |
allowing people investigating derivatives to get an alternative
|
|
|
1427 |
view of what $r_1 \cdot r_2$ is.
|
|
532
|
1428 |
|
|
558
|
1429 |
Now we are able to use this for the intuition that
|
|
|
1430 |
the different ways in which regular expressions are
|
|
|
1431 |
nested do not matter under $\rsimp{}$:
|
|
557
|
1432 |
\begin{center}
|
|
558
|
1433 |
$\rsimp{r} \stackrel{?}{\sequal} \rsimp{r'}$ if $r = \sum [r_1, r_2, r_3, \ldots]$
|
|
593
|
1434 |
and $r' =(\ldots ((r_1 + r_2) + r_3) + \ldots)$
|
|
557
|
1435 |
\end{center}
|
|
558
|
1436 |
Simply wrap with $\sum$ constructor and add
|
|
|
1437 |
simplifications to both sides of \ref{seqSfau0}
|
|
|
1438 |
and one gets
|
|
|
1439 |
\begin{corollary}\label{seqClosedFormGeneral}
|
|
|
1440 |
$\rsimp{\sflat{(r_1 \cdot r_2) \backslash s} }
|
|
|
1441 |
=\rsimp{(\sum ( (r_1 \backslash s) \cdot r_2 ::
|
|
593
|
1442 |
\map\; (r_2 \backslash \_) \; (\vsuf{s}{r_1})))}$
|
|
558
|
1443 |
\end{corollary}
|
|
|
1444 |
Together with the idempotency property of $\rsimp{}$ (lemma \ref{rsimpIdem}),
|
|
|
1445 |
it is possible to convert the above lemma to obtain a "closed form"
|
|
|
1446 |
for derivatives nested with simplification:
|
|
|
1447 |
\begin{lemma}\label{seqClosedForm}
|
|
|
1448 |
$\rderssimp{(r_1 \cdot r_2)}{s} = \rsimp{(\sum ((r_1 \backslash s) \cdot r_2 )
|
|
|
1449 |
:: (\map \; (r_2 \backslash \_) (\vsuf{s}{r_1})))}$
|
|
|
1450 |
\end{lemma}
|
|
|
1451 |
\begin{proof}
|
|
|
1452 |
By a case analysis of string $s$.
|
|
|
1453 |
When $s$ is empty list, the rewrite is straightforward.
|
|
|
1454 |
When $s$ is a list, one could use the corollary \ref{seqSfau0},
|
|
|
1455 |
and lemma \ref{Simpders} to rewrite the left-hand-side.
|
|
|
1456 |
\end{proof}
|
|
|
1457 |
As a corollary for this closed form, one can estimate the size
|
|
|
1458 |
of the sequence derivative $r_1 \cdot r_2 \backslash_r s$ using
|
|
|
1459 |
an easier-to-handle expression:
|
|
|
1460 |
\begin{corollary}\label{seqEstimate1}
|
|
|
1461 |
\begin{center}
|
|
557
|
1462 |
|
|
593
|
1463 |
$\llbracket \rderssimp{(r_1 \cdot r_2)}{s} \rrbracket_r = \llbracket \rsimp{(\sum ((r_1 \backslash s) \cdot r_2 )
|
|
|
1464 |
:: (\map \; (r_2 \backslash \_) (\vsuf{s}{r_1})))} \rrbracket_r$
|
|
|
1465 |
|
|
558
|
1466 |
\end{center}
|
|
|
1467 |
\end{corollary}
|
|
|
1468 |
\noindent
|
|
|
1469 |
\subsection{Closed Forms for Star Regular Expressions}
|
|
564
|
1470 |
We have shown how to control the size of the sequence regular expression $r_1\cdot r_2$ using
|
|
|
1471 |
the "closed form" of $(r_1 \cdot r_2) \backslash s$ and then
|
|
|
1472 |
the property of the $\distinct$ function.
|
|
|
1473 |
Now we try to get a bound on $r^* \backslash s$ as well.
|
|
|
1474 |
Again, we first look at how a star's derivatives evolve, if they grow maximally:
|
|
|
1475 |
\begin{center}
|
|
|
1476 |
|
|
593
|
1477 |
$r^* \quad \longrightarrow_{\backslash c} \quad (r\backslash c) \cdot r^* \quad \longrightarrow_{\backslash c'} \quad
|
|
|
1478 |
r \backslash cc' \cdot r^* + r \backslash c' \cdot r^* \quad \longrightarrow_{\backslash c''} \quad
|
|
|
1479 |
(r_1 \backslash cc'c'' \cdot r^* + r \backslash c'') + (r \backslash c'c'' \cdot r^* + r \backslash c'' \cdot r^*) \quad \longrightarrow_{\backslash c'''}
|
|
|
1480 |
\quad \ldots$
|
|
564
|
1481 |
|
|
|
1482 |
\end{center}
|
|
|
1483 |
When we have a string $s = c :: c' :: c'' \ldots$ such that $r \backslash c$, $r \backslash cc'$, $r \backslash c'$,
|
|
|
1484 |
$r \backslash cc'c''$, $r \backslash c'c''$, $r\backslash c''$ etc. are all nullable,
|
|
|
1485 |
the number of terms in $r^* \backslash s$ will grow exponentially, causing the size
|
|
|
1486 |
of the derivatives $r^* \backslash s$ to grow exponentially, even if we do not
|
|
|
1487 |
count the possible size explosions of $r \backslash c$ themselves.
|
|
|
1488 |
|
|
576
|
1489 |
Thanks to $\rflts$ and $\rDistinct$, we are able to open up regular expressions like
|
|
564
|
1490 |
$(r_1 \backslash cc'c'' \cdot r^* + r \backslash c'') +
|
|
|
1491 |
(r \backslash c'c'' \cdot r^* + r \backslash c'' \cdot r^*) $
|
|
|
1492 |
into $\RALTS{[r_1 \backslash cc'c'' \cdot r^*, r \backslash c'',
|
|
|
1493 |
r \backslash c'c'' \cdot r^*, r \backslash c'' \cdot r^*]}$
|
|
|
1494 |
and then de-duplicate terms of the form $r\backslash s' \cdot r^*$ ($s'$ being a substring of $s$).
|
|
|
1495 |
This allows us to use a similar technique as $r_1 \cdot r_2$ case,
|
|
|
1496 |
where the crux is to get an equivalent form of
|
|
|
1497 |
$\rderssimp{r^*}{s}$ with shape $\rsimp{\sum rs}$.
|
|
|
1498 |
This requires generating
|
|
558
|
1499 |
all possible sub-strings $s'$ of $s$
|
|
|
1500 |
such that $r\backslash s' \cdot r^*$ will appear
|
|
|
1501 |
as a term in $(r^*) \backslash s$.
|
|
|
1502 |
The first function we define is a single-step
|
|
|
1503 |
updating function $\starupdate$, which takes three arguments as input:
|
|
|
1504 |
the new character $c$ to take derivative with,
|
|
|
1505 |
the regular expression
|
|
|
1506 |
$r$ directly under the star $r^*$, and the
|
|
|
1507 |
list of strings $sSet$ for the derivative $r^* \backslash s$
|
|
|
1508 |
up til this point
|
|
|
1509 |
such that $(r^*) \backslash s = \sum_{s' \in sSet} (r\backslash s') \cdot r^*$
|
|
|
1510 |
(the equality is not exact, more on this later).
|
|
|
1511 |
\begin{center}
|
|
|
1512 |
\begin{tabular}{lcl}
|
|
|
1513 |
$\starupdate \; c \; r \; [] $ & $\dn$ & $[]$\\
|
|
|
1514 |
$\starupdate \; c \; r \; (s :: Ss)$ & $\dn$ & \\
|
|
|
1515 |
& & $\textit{if} \;
|
|
|
1516 |
(\rnullable \; (\rders \; r \; s))$ \\
|
|
|
1517 |
& & $\textit{then} \;\; (s @ [c]) :: [c] :: (
|
|
|
1518 |
\starupdate \; c \; r \; Ss)$ \\
|
|
|
1519 |
& & $\textit{else} \;\; (s @ [c]) :: (
|
|
|
1520 |
\starupdate \; c \; r \; Ss)$
|
|
|
1521 |
\end{tabular}
|
|
|
1522 |
\end{center}
|
|
|
1523 |
\noindent
|
|
|
1524 |
As a generalisation from characters to strings,
|
|
|
1525 |
$\starupdates$ takes a string instead of a character
|
|
|
1526 |
as the first input argument, and is otherwise the same
|
|
|
1527 |
as $\starupdate$.
|
|
|
1528 |
\begin{center}
|
|
|
1529 |
\begin{tabular}{lcl}
|
|
|
1530 |
$\starupdates \; [] \; r \; Ss$ & $=$ & $Ss$\\
|
|
|
1531 |
$\starupdates \; (c :: cs) \; r \; Ss$ & $=$ & $\starupdates \; cs \; r \; (
|
|
|
1532 |
\starupdate \; c \; r \; Ss)$
|
|
|
1533 |
\end{tabular}
|
|
|
1534 |
\end{center}
|
|
|
1535 |
\noindent
|
|
|
1536 |
For the star regular expression,
|
|
|
1537 |
its derivatives can be seen as a nested gigantic
|
|
|
1538 |
alternative similar to that of sequence regular expression's derivatives,
|
|
|
1539 |
and therefore need
|
|
|
1540 |
to be ``straightened out" as well.
|
|
|
1541 |
The function for this would be $\hflat{}$ and $\hflataux{}$.
|
|
|
1542 |
\begin{center}
|
|
|
1543 |
\begin{tabular}{lcl}
|
|
|
1544 |
$\hflataux{r_1 + r_2}$ & $\dn$ & $\hflataux{r_1} @ \hflataux{r_2}$\\
|
|
|
1545 |
$\hflataux{r}$ & $\dn$ & $[r]$
|
|
|
1546 |
\end{tabular}
|
|
|
1547 |
\end{center}
|
|
557
|
1548 |
|
|
|
1549 |
\begin{center}
|
|
558
|
1550 |
\begin{tabular}{lcl}
|
|
|
1551 |
$\hflat{r_1 + r_2}$ & $\dn$ & $\sum (\hflataux {r_1} @ \hflataux {r_2}) $\\
|
|
|
1552 |
$\hflat{r}$ & $\dn$ & $r$
|
|
|
1553 |
\end{tabular}
|
|
|
1554 |
\end{center}
|
|
|
1555 |
\noindent
|
|
|
1556 |
%MAYBE TODO: introduce createdByStar
|
|
564
|
1557 |
Again these definitions are tailor-made for dealing with alternatives that have
|
|
|
1558 |
originated from a star's derivatives, so we do not attempt to open up all possible
|
|
576
|
1559 |
regular expressions of the form $\RALTS{rs}$, where $\textit{rs}$ might not contain precisely 2
|
|
564
|
1560 |
elements.
|
|
|
1561 |
We give a predicate for such "star-created" regular expressions:
|
|
|
1562 |
\begin{center}
|
|
593
|
1563 |
\begin{tabular}{lcr}
|
|
|
1564 |
& & $\createdByStar{(\RSEQ{ra}{\RSTAR{rb}}) }$\\
|
|
|
1565 |
$\createdByStar{r_1} \land \createdByStar{r_2} $ & $ \Longrightarrow$ & $\createdByStar{(r_1 + r_2)}$
|
|
|
1566 |
\end{tabular}
|
|
|
1567 |
\end{center}
|
|
|
1568 |
|
|
|
1569 |
These definitions allows us the flexibility to talk about
|
|
|
1570 |
regular expressions in their most convenient format,
|
|
|
1571 |
for example, flattened out $\RALTS{[r_1, r_2, \ldots, r_n]} $
|
|
|
1572 |
instead of binary-nested: $((r_1 + r_2) + (r_3 + r_4)) + \ldots$.
|
|
|
1573 |
These definitions help express that certain classes of syntatically
|
|
|
1574 |
distinct regular expressions are actually the same under simplification.
|
|
|
1575 |
This is not entirely true for annotated regular expressions:
|
|
|
1576 |
%TODO: bsimp bders \neq bderssimp
|
|
|
1577 |
\begin{center}
|
|
|
1578 |
$(1+ (c\cdot \ASEQ{bs}{c^*}{c} ))$
|
|
|
1579 |
\end{center}
|
|
|
1580 |
For bit-codes, the order in which simplification is applied
|
|
|
1581 |
might cause a difference in the location they are placed.
|
|
|
1582 |
If we want something like
|
|
|
1583 |
\begin{center}
|
|
|
1584 |
$\bderssimp{r}{s} \myequiv \bsimp{\bders{r}{s}}$
|
|
|
1585 |
\end{center}
|
|
|
1586 |
Some "canonicalization" procedure is required,
|
|
|
1587 |
which either pushes all the common bitcodes to nodes
|
|
|
1588 |
as senior as possible:
|
|
|
1589 |
\begin{center}
|
|
|
1590 |
$_{bs}(_{bs_1 @ bs'}r_1 + _{bs_1 @ bs''}r_2) \rightarrow _{bs @ bs_1}(_{bs'}r_1 + _{bs''}r_2) $
|
|
|
1591 |
\end{center}
|
|
|
1592 |
or does the reverse. However bitcodes are not of interest if we are talking about
|
|
|
1593 |
the $\llbracket r \rrbracket$ size of a regex.
|
|
|
1594 |
Therefore for the ease and simplicity of producing a
|
|
|
1595 |
proof for a size bound, we are happy to restrict ourselves to
|
|
|
1596 |
unannotated regular expressions, and obtain such equalities as
|
|
|
1597 |
\begin{lemma}
|
|
|
1598 |
$\rsimp{r_1 + r_2} = \rsimp{\RALTS{\hflataux{r_1} @ \hflataux{r_2}}}$
|
|
|
1599 |
\end{lemma}
|
|
|
1600 |
|
|
|
1601 |
\begin{proof}
|
|
|
1602 |
By using the rewriting relation $\rightsquigarrow$
|
|
|
1603 |
\end{proof}
|
|
|
1604 |
%TODO: rsimp sflat
|
|
564
|
1605 |
And from this we obtain a proof that a star's derivative will be the same
|
|
|
1606 |
as if it had all its nested alternatives created during deriving being flattened out:
|
|
593
|
1607 |
For example,
|
|
|
1608 |
\begin{lemma}
|
|
|
1609 |
$\createdByStar{r} \implies \rsimp{r} = \rsimp{\RALTS{\hflataux{r}}}$
|
|
|
1610 |
\end{lemma}
|
|
|
1611 |
\begin{proof}
|
|
|
1612 |
By structural induction on $r$, where the induction rules are these of $\createdByStar{_}$.
|
|
|
1613 |
\end{proof}
|
|
564
|
1614 |
% The simplification of a flattened out regular expression, provided it comes
|
|
|
1615 |
%from the derivative of a star, is the same as the one nested.
|
|
593
|
1616 |
|
|
564
|
1617 |
|
|
|
1618 |
|
|
558
|
1619 |
We first introduce an inductive property
|
|
|
1620 |
for $\starupdate$ and $\hflataux{\_}$,
|
|
|
1621 |
it says if we do derivatives of $r^*$
|
|
|
1622 |
with a string that starts with $c$,
|
|
|
1623 |
then flatten it out,
|
|
|
1624 |
we obtain a list
|
|
|
1625 |
of the shape $\sum_{s' \in sSet} (r\backslash_r s') \cdot r^*$,
|
|
|
1626 |
where $sSet = \starupdates \; s \; r \; [[c]]$.
|
|
|
1627 |
\begin{lemma}\label{starHfauInduct}
|
|
|
1628 |
$\hflataux{(\rders{( (\rder{c}{r_0})\cdot(r_0^*))}{s})} =
|
|
|
1629 |
\map \; (\lambda s_1. (r_0 \backslash_r s_1) \cdot (r_0^*)) \;
|
|
|
1630 |
(\starupdates \; s \; r_0 \; [[c]])$
|
|
|
1631 |
\end{lemma}
|
|
|
1632 |
\begin{proof}
|
|
|
1633 |
By an induction on $s$, the inductive cases
|
|
|
1634 |
being $[]$ and $s@[c]$.
|
|
|
1635 |
\end{proof}
|
|
|
1636 |
\noindent
|
|
|
1637 |
Here is a corollary that states the lemma in
|
|
|
1638 |
a more intuitive way:
|
|
|
1639 |
\begin{corollary}
|
|
|
1640 |
$\hflataux{r^* \backslash_r (c::xs)} = \map \; (\lambda s. (r \backslash_r s) \cdot
|
|
|
1641 |
(r^*))\; (\starupdates \; c\; r\; [[c]])$
|
|
|
1642 |
\end{corollary}
|
|
|
1643 |
\noindent
|
|
|
1644 |
Note that this is also agnostic of the simplification
|
|
|
1645 |
function we defined, and is therefore of more general interest.
|
|
|
1646 |
|
|
|
1647 |
Now adding the $\rsimp{}$ bit for closed forms,
|
|
|
1648 |
we have
|
|
|
1649 |
\begin{lemma}
|
|
|
1650 |
$a :: rs \grewrites \hflataux{a} @ rs$
|
|
|
1651 |
\end{lemma}
|
|
|
1652 |
\noindent
|
|
|
1653 |
giving us
|
|
|
1654 |
\begin{lemma}\label{cbsHfauRsimpeq1}
|
|
|
1655 |
$\rsimp{a+b} = \rsimp{(\sum \hflataux{a} @ \hflataux{b})}$.
|
|
|
1656 |
\end{lemma}
|
|
|
1657 |
\noindent
|
|
|
1658 |
This yields
|
|
|
1659 |
\begin{lemma}\label{hfauRsimpeq2}
|
|
593
|
1660 |
$\rsimp{r} = \rsimp{(\sum \hflataux{r})}$
|
|
558
|
1661 |
\end{lemma}
|
|
|
1662 |
\noindent
|
|
|
1663 |
Together with the rewriting relation
|
|
|
1664 |
\begin{lemma}\label{starClosedForm6Hrewrites}
|
|
|
1665 |
$\map \; (\lambda s. (\rsimp{r \backslash_r s}) \cdot (r^*)) \; Ss
|
|
|
1666 |
\scfrewrites
|
|
593
|
1667 |
\map \; (\lambda s. (\rsimp{r \backslash_r s}) \cdot (r^*)) \; Ss$
|
|
558
|
1668 |
\end{lemma}
|
|
|
1669 |
\noindent
|
|
|
1670 |
We obtain the closed form for star regular expression:
|
|
|
1671 |
\begin{lemma}\label{starClosedForm}
|
|
|
1672 |
$\rderssimp{r^*}{c::s} =
|
|
|
1673 |
\rsimp{
|
|
|
1674 |
(\sum (\map \; (\lambda s. (\rderssimp{r}{s})\cdot r^*) \;
|
|
593
|
1675 |
(\starupdates \; s\; r \; [[c]])
|
|
558
|
1676 |
)
|
|
593
|
1677 |
)
|
|
|
1678 |
}
|
|
558
|
1679 |
$
|
|
|
1680 |
\end{lemma}
|
|
|
1681 |
\begin{proof}
|
|
|
1682 |
By an induction on $s$.
|
|
|
1683 |
The lemmas \ref{rsimpIdem}, \ref{starHfauInduct}, and \ref{hfauRsimpeq2}
|
|
|
1684 |
are used.
|
|
|
1685 |
\end{proof}
|
|
|
1686 |
\section{Estimating the Closed Forms' sizes}
|
|
|
1687 |
We now summarize the closed forms below:
|
|
|
1688 |
\begin{itemize}
|
|
|
1689 |
\item
|
|
593
|
1690 |
$\rderssimp{(\sum rs)}{s} \sequal
|
|
|
1691 |
\sum \; (\map \; (\rderssimp{\_}{s}) \; rs)$
|
|
558
|
1692 |
\item
|
|
593
|
1693 |
$\rderssimp{(r_1 \cdot r_2)}{s} \sequal \sum ((r_1 \backslash s) \cdot r_2 )
|
|
|
1694 |
:: (\map \; (r_2 \backslash \_) (\vsuf{s}{r_1}))$
|
|
558
|
1695 |
\item
|
|
|
1696 |
|
|
593
|
1697 |
$\rderssimp{r^*}{c::s} =
|
|
|
1698 |
\rsimp{
|
|
|
1699 |
(\sum (\map \; (\lambda s. (\rderssimp{r}{s})\cdot r^*) \;
|
|
558
|
1700 |
(\starupdates \; s\; r \; [[c]])
|
|
593
|
1701 |
)
|
|
|
1702 |
)
|
|
|
1703 |
}
|
|
|
1704 |
$
|
|
558
|
1705 |
\end{itemize}
|
|
|
1706 |
\noindent
|
|
|
1707 |
The closed forms on the left-hand-side
|
|
|
1708 |
are all of the same shape: $\rsimp{ (\sum rs)} $.
|
|
|
1709 |
Such regular expression will be bounded by the size of $\sum rs'$,
|
|
|
1710 |
where every element in $rs'$ is distinct, and each element
|
|
|
1711 |
can be described by some inductive sub-structures
|
|
|
1712 |
(for example when $r = r_1 \cdot r_2$ then $rs'$
|
|
|
1713 |
will be solely comprised of $r_1 \backslash s'$
|
|
|
1714 |
and $r_2 \backslash s''$, $s'$ and $s''$ being
|
|
|
1715 |
sub-strings of $s$).
|
|
|
1716 |
which will each have a size uppder bound
|
|
|
1717 |
according to inductive hypothesis, which controls $r \backslash s$.
|
|
557
|
1718 |
|
|
558
|
1719 |
We elaborate the above reasoning by a series of lemmas
|
|
|
1720 |
below, where straightforward proofs are omitted.
|
|
532
|
1721 |
\begin{lemma}
|
|
558
|
1722 |
If $\forall r \in rs. \rsize{r} $ is less than or equal to $N$,
|
|
|
1723 |
and $\textit{length} \; rs$ is less than or equal to $l$,
|
|
|
1724 |
then $\rsize{\sum rs}$ is less than or equal to $l*N + 1$.
|
|
|
1725 |
\end{lemma}
|
|
|
1726 |
\noindent
|
|
|
1727 |
If we define all regular expressions with size no
|
|
|
1728 |
more than $N$ as $\sizeNregex \; N$:
|
|
|
1729 |
\[
|
|
|
1730 |
\sizeNregex \; N \dn \{r \mid \rsize{r} \leq N \}
|
|
|
1731 |
\]
|
|
|
1732 |
Then such set is finite:
|
|
|
1733 |
\begin{lemma}\label{finiteSizeN}
|
|
|
1734 |
$\textit{isFinite}\; (\sizeNregex \; N)$
|
|
|
1735 |
\end{lemma}
|
|
|
1736 |
\begin{proof}
|
|
|
1737 |
By overestimating the set $\sizeNregex \; N + 1$
|
|
|
1738 |
using union of sets like
|
|
|
1739 |
$\{r_1 \cdot r_2 \mid r_1 \in A
|
|
|
1740 |
\text{and}
|
|
593
|
1741 |
r_2 \in A\}
|
|
558
|
1742 |
$ where $A = \sizeNregex \; N$.
|
|
|
1743 |
\end{proof}
|
|
|
1744 |
\noindent
|
|
|
1745 |
From this we get a corollary that
|
|
|
1746 |
if forall $r \in rs$, $\rsize{r} \leq N$, then the output of
|
|
|
1747 |
$\rdistinct{rs}{\varnothing}$ is a list of regular
|
|
|
1748 |
expressions of finite size depending on $N$ only.
|
|
561
|
1749 |
\begin{corollary}\label{finiteSizeNCorollary}
|
|
558
|
1750 |
Assumes that for all $r \in rs. \rsize{r} \leq N$,
|
|
|
1751 |
and the cardinality of $\sizeNregex \; N$ is $c_N$
|
|
|
1752 |
then$\rsize{\rdistinct{rs}{\varnothing}} \leq c*N$.
|
|
|
1753 |
\end{corollary}
|
|
|
1754 |
\noindent
|
|
|
1755 |
We have proven that the output of $\rdistinct{rs'}{\varnothing}$
|
|
|
1756 |
is bounded by a constant $c_N$ depending only on $N$,
|
|
|
1757 |
provided that each of $rs'$'s element
|
|
|
1758 |
is bounded by $N$.
|
|
|
1759 |
We want to apply it to our setting $\rsize{\rsimp{\sum rs}}$.
|
|
|
1760 |
|
|
|
1761 |
We show how $\rdistinct$ and $\rflts$
|
|
|
1762 |
in the simplification function together is at least as
|
|
|
1763 |
good as $\rdistinct{}{}$ alone.
|
|
|
1764 |
\begin{lemma}\label{interactionFltsDB}
|
|
|
1765 |
$\llbracket \rdistinct{(\rflts \; \textit{rs})}{\varnothing} \rrbracket_r
|
|
|
1766 |
\leq
|
|
|
1767 |
\llbracket \rdistinct{rs}{\varnothing} \rrbracket_r $.
|
|
532
|
1768 |
\end{lemma}
|
|
558
|
1769 |
\noindent
|
|
|
1770 |
The intuition is that if we remove duplicates from the $\textit{LHS}$, at least the same amount of
|
|
|
1771 |
duplicates will be removed from the list $\textit{rs}$ in the $\textit{RHS}$.
|
|
|
1772 |
|
|
|
1773 |
Now this $\rsimp{\sum rs}$ can be estimated using $\rdistinct{rs}{\varnothing}$:
|
|
|
1774 |
\begin{lemma}\label{altsSimpControl}
|
|
|
1775 |
$\rsize{\rsimp{\sum rs}} \leq \rsize{\rdistinct{rs}{\varnothing}}+ 1$
|
|
532
|
1776 |
\end{lemma}
|
|
558
|
1777 |
\begin{proof}
|
|
|
1778 |
By using \ref{interactionFltsDB}.
|
|
|
1779 |
\end{proof}
|
|
|
1780 |
\noindent
|
|
|
1781 |
which says that the size of regular expression
|
|
|
1782 |
is always smaller if we apply the full simplification
|
|
|
1783 |
rather than just one component ($\rdistinct{}{}$).
|
|
|
1784 |
|
|
|
1785 |
|
|
|
1786 |
Now we are ready to control the sizes of
|
|
|
1787 |
$r_1 \cdot r_2 \backslash s$, $r^* \backslash s$.
|
|
|
1788 |
\begin{theorem}
|
|
593
|
1789 |
For any regex $r$, $\exists N_r. \forall s. \; \rsize{\rderssimp{r}{s}} \leq N_r$
|
|
558
|
1790 |
\end{theorem}
|
|
|
1791 |
\noindent
|
|
|
1792 |
\begin{proof}
|
|
593
|
1793 |
We prove this by induction on $r$. The base cases for $\RZERO$,
|
|
|
1794 |
$\RONE $ and $\RCHAR{c}$ are straightforward.
|
|
|
1795 |
In the sequence $r_1 \cdot r_2$ case,
|
|
|
1796 |
the inductive hypotheses state
|
|
|
1797 |
$\exists N_1. \forall s. \; \llbracket \rderssimp{r}{s} \rrbracket \leq N_1$ and
|
|
|
1798 |
$\exists N_2. \forall s. \; \llbracket \rderssimp{r_2}{s} \rrbracket \leq N_2$.
|
|
562
|
1799 |
|
|
593
|
1800 |
When the string $s$ is not empty, we can reason as follows
|
|
|
1801 |
%
|
|
|
1802 |
\begin{center}
|
|
|
1803 |
\begin{tabular}{lcll}
|
|
558
|
1804 |
& & $ \llbracket \rderssimp{r_1\cdot r_2 }{s} \rrbracket_r $\\
|
|
561
|
1805 |
& $ = $ & $\llbracket \rsimp{(\sum(r_1 \backslash_{rsimp} s \cdot r_2 \; \; :: \; \;
|
|
593
|
1806 |
\map \; (r_2\backslash_{rsimp} \_)\; (\vsuf{s}{r})))} \rrbracket_r $ & (1) \\
|
|
|
1807 |
& $\leq$ & $\llbracket \rdistinct{(r_1 \backslash_{rsimp} s \cdot r_2 \; \; :: \; \;
|
|
|
1808 |
\map \; (r_2\backslash_{rsimp} \_)\; (\vsuf{s}{r}))}{\varnothing} \rrbracket_r + 1$ & (2) \\
|
|
|
1809 |
& $\leq$ & $2 + N_1 + \rsize{r_2} + (N_2 * (card\;(\sizeNregex \; N_2)))$ & (3)\\
|
|
558
|
1810 |
\end{tabular}
|
|
|
1811 |
\end{center}
|
|
561
|
1812 |
\noindent
|
|
|
1813 |
(1) is by the corollary \ref{seqEstimate1}.
|
|
|
1814 |
(2) is by \ref{altsSimpControl}.
|
|
|
1815 |
(3) is by \ref{finiteSizeNCorollary}.
|
|
562
|
1816 |
|
|
|
1817 |
|
|
|
1818 |
Combining the cases when $s = []$ and $s \neq []$, we get (4):
|
|
|
1819 |
\begin{center}
|
|
|
1820 |
\begin{tabular}{lcll}
|
|
|
1821 |
$\rsize{(r_1 \cdot r_2) \backslash_r s}$ & $\leq$ &
|
|
|
1822 |
$max \; (2 + N_1 +
|
|
|
1823 |
\llbracket r_2 \rrbracket_r +
|
|
|
1824 |
N_2 * (card\; (\sizeNregex \; N_2))) \; \rsize{r_1\cdot r_2}$ & (4)
|
|
|
1825 |
\end{tabular}
|
|
|
1826 |
\end{center}
|
|
558
|
1827 |
|
|
562
|
1828 |
We reason similarly for $\STAR$.
|
|
|
1829 |
The inductive hypothesis is
|
|
|
1830 |
$\exists N. \forall s. \; \llbracket \rderssimp{r}{s} \rrbracket \leq N$.
|
|
564
|
1831 |
Let $n_r = \llbracket r^* \rrbracket_r$.
|
|
562
|
1832 |
When $s = c :: cs$ is not empty,
|
|
|
1833 |
\begin{center}
|
|
593
|
1834 |
\begin{tabular}{lcll}
|
|
562
|
1835 |
& & $ \llbracket \rderssimp{r^* }{c::cs} \rrbracket_r $\\
|
|
|
1836 |
& $ = $ & $\llbracket \rsimp{(\sum (\map \; (\lambda s. (r \backslash_{rsimp} s) \cdot r^*) \; (\starupdates\;
|
|
593
|
1837 |
cs \; r \; [[c]] )) )} \rrbracket_r $ & (5) \\
|
|
|
1838 |
& $\leq$ & $\llbracket
|
|
|
1839 |
\rdistinct{
|
|
|
1840 |
(\map \;
|
|
|
1841 |
(\lambda s. (r \backslash_{rsimp} s) \cdot r^*) \;
|
|
|
1842 |
(\starupdates\; cs \; r \; [[c]] )
|
|
|
1843 |
)}
|
|
562
|
1844 |
{\varnothing} \rrbracket_r + 1$ & (6) \\
|
|
|
1845 |
& $\leq$ & $1 + (\textit{card} (\sizeNregex \; (N + n_r)))
|
|
|
1846 |
* (1 + (N + n_r)) $ & (7)\\
|
|
|
1847 |
\end{tabular}
|
|
|
1848 |
\end{center}
|
|
|
1849 |
\noindent
|
|
|
1850 |
(5) is by the lemma \ref{starClosedForm}.
|
|
|
1851 |
(6) is by \ref{altsSimpControl}.
|
|
|
1852 |
(7) is by \ref{finiteSizeNCorollary}.
|
|
|
1853 |
Combining with the case when $s = []$, one gets
|
|
|
1854 |
\begin{center}
|
|
593
|
1855 |
\begin{tabular}{lcll}
|
|
|
1856 |
$\rsize{r^* \backslash_r s}$ & $\leq$ & $max \; n_r \; 1 + (\textit{card} (\sizeNregex \; (N + n_r)))
|
|
|
1857 |
* (1 + (N + n_r)) $ & (8)\\
|
|
|
1858 |
\end{tabular}
|
|
562
|
1859 |
\end{center}
|
|
|
1860 |
\noindent
|
|
|
1861 |
|
|
|
1862 |
The alternative case is slightly less involved.
|
|
|
1863 |
The inductive hypothesis
|
|
|
1864 |
is equivalent to $\exists N. \forall r \in (\map \; (\_ \backslash_r s) \; rs). \rsize{r} \leq N$.
|
|
|
1865 |
In the case when $s = c::cs$, we have
|
|
|
1866 |
\begin{center}
|
|
593
|
1867 |
\begin{tabular}{lcll}
|
|
562
|
1868 |
& & $ \llbracket \rderssimp{\sum rs }{c::cs} \rrbracket_r $\\
|
|
|
1869 |
& $ = $ & $\llbracket \rsimp{(\sum (\map \; (\_ \backslash_{rsimp} s) \; rs) )} \rrbracket_r $ & (9) \\
|
|
|
1870 |
& $\leq$ & $\llbracket (\sum (\map \; (\_ \backslash_{rsimp} s) \; rs) ) \rrbracket_r $ & (10) \\
|
|
|
1871 |
& $\leq$ & $1 + N * (length \; rs) $ & (11)\\
|
|
593
|
1872 |
\end{tabular}
|
|
562
|
1873 |
\end{center}
|
|
|
1874 |
\noindent
|
|
|
1875 |
(9) is by \ref{altsClosedForm}, (10) by \ref{rsimpSize} and (11) by inductive hypothesis.
|
|
|
1876 |
|
|
|
1877 |
Combining with the case when $s = []$, one gets
|
|
|
1878 |
\begin{center}
|
|
593
|
1879 |
\begin{tabular}{lcll}
|
|
|
1880 |
$\rsize{\sum rs \backslash_r s}$ & $\leq$ & $max \; \rsize{\sum rs} \; 1+N*(length \; rs)$
|
|
|
1881 |
& (12)\\
|
|
|
1882 |
\end{tabular}
|
|
562
|
1883 |
\end{center}
|
|
|
1884 |
(4), (8), and (12) are all the inductive cases proven.
|
|
558
|
1885 |
\end{proof}
|
|
|
1886 |
|
|
564
|
1887 |
|
|
|
1888 |
\begin{corollary}
|
|
593
|
1889 |
For any regex $a$, $\exists N_r. \forall s. \; \rsize{\bderssimp{a}{s}} \leq N_r$
|
|
564
|
1890 |
\end{corollary}
|
|
|
1891 |
\begin{proof}
|
|
|
1892 |
By \ref{sizeRelations}.
|
|
|
1893 |
\end{proof}
|
|
558
|
1894 |
\noindent
|
|
|
1895 |
|
|
|
1896 |
%-----------------------------------
|
|
|
1897 |
% SECTION 2
|
|
|
1898 |
%-----------------------------------
|
|
|
1899 |
|
|
532
|
1900 |
|
|
557
|
1901 |
%----------------------------------------------------------------------------------------
|
|
|
1902 |
% SECTION 3
|
|
|
1903 |
%----------------------------------------------------------------------------------------
|
|
|
1904 |
|
|
532
|
1905 |
|
|
554
|
1906 |
\subsection{A Closed Form for the Sequence Regular Expression}
|
|
|
1907 |
\noindent
|
|
|
1908 |
|
|
|
1909 |
Before we get to the proof that says the intermediate result of our lexer will
|
|
|
1910 |
remain finitely bounded, which is an important efficiency/liveness guarantee,
|
|
|
1911 |
we shall first develop a few preparatory properties and definitions to
|
|
|
1912 |
make the process of proving that a breeze.
|
|
|
1913 |
|
|
|
1914 |
We define rewriting relations for $\rrexp$s, which allows us to do the
|
|
|
1915 |
same trick as we did for the correctness proof,
|
|
|
1916 |
but this time we will have stronger equalities established.
|
|
|
1917 |
|
|
532
|
1918 |
|
|
|
1919 |
|
|
|
1920 |
What guarantee does this bound give us?
|
|
|
1921 |
|
|
|
1922 |
Whatever the regex is, it will not grow indefinitely.
|
|
|
1923 |
Take our previous example $(a + aa)^*$ as an example:
|
|
|
1924 |
\begin{center}
|
|
593
|
1925 |
\begin{tabular}{@{}c@{\hspace{0mm}}c@{\hspace{0mm}}c@{}}
|
|
|
1926 |
\begin{tikzpicture}
|
|
|
1927 |
\begin{axis}[
|
|
|
1928 |
xlabel={number of $a$'s},
|
|
|
1929 |
x label style={at={(1.05,-0.05)}},
|
|
|
1930 |
ylabel={regex size},
|
|
|
1931 |
enlargelimits=false,
|
|
|
1932 |
xtick={0,5,...,30},
|
|
|
1933 |
xmax=33,
|
|
|
1934 |
ymax= 40,
|
|
|
1935 |
ytick={0,10,...,40},
|
|
|
1936 |
scaled ticks=false,
|
|
|
1937 |
axis lines=left,
|
|
|
1938 |
width=5cm,
|
|
|
1939 |
height=4cm,
|
|
|
1940 |
legend entries={$(a + aa)^*$},
|
|
|
1941 |
legend pos=north west,
|
|
|
1942 |
legend cell align=left]
|
|
|
1943 |
\addplot[red,mark=*, mark options={fill=white}] table {a_aa_star.data};
|
|
|
1944 |
\end{axis}
|
|
|
1945 |
\end{tikzpicture}
|
|
|
1946 |
\end{tabular}
|
|
532
|
1947 |
\end{center}
|
|
|
1948 |
We are able to limit the size of the regex $(a + aa)^*$'s derivatives
|
|
593
|
1949 |
with our simplification
|
|
532
|
1950 |
rules very effectively.
|
|
|
1951 |
|
|
|
1952 |
|
|
|
1953 |
In our proof for the inductive case $r_1 \cdot r_2$, the dominant term in the bound
|
|
|
1954 |
is $l_{N_2} * N_2$, where $N_2$ is the bound we have for $\llbracket \bderssimp{r_2}{s} \rrbracket$.
|
|
|
1955 |
Given that $l_{N_2}$ is roughly the size $4^{N_2}$, the size bound $\llbracket \bderssimp{r_1 \cdot r_2}{s} \rrbracket$
|
|
|
1956 |
inflates the size bound of $\llbracket \bderssimp{r_2}{s} \rrbracket$ with the function
|
|
|
1957 |
$f(x) = x * 2^x$.
|
|
|
1958 |
This means the bound we have will surge up at least
|
|
|
1959 |
tower-exponentially with a linear increase of the depth.
|
|
|
1960 |
For a regex of depth $n$, the bound
|
|
|
1961 |
would be approximately $4^n$.
|
|
|
1962 |
|
|
|
1963 |
Test data in the graphs from randomly generated regular expressions
|
|
|
1964 |
shows that the giant bounds are far from being hit.
|
|
|
1965 |
%a few sample regular experessions' derivatives
|
|
|
1966 |
%size change
|
|
576
|
1967 |
%TODO: giving regex1_size_change.data showing a few regular expressions' size changes
|
|
532
|
1968 |
%w;r;t the input characters number, where the size is usually cubic in terms of original size
|
|
|
1969 |
%a*, aa*, aaa*, .....
|
|
576
|
1970 |
%randomly generated regular expressions
|
|
532
|
1971 |
\begin{center}
|
|
593
|
1972 |
\begin{tabular}{@{}c@{\hspace{0mm}}c@{\hspace{0mm}}c@{}}
|
|
|
1973 |
\begin{tikzpicture}
|
|
|
1974 |
\begin{axis}[
|
|
|
1975 |
xlabel={number of $a$'s},
|
|
|
1976 |
x label style={at={(1.05,-0.05)}},
|
|
|
1977 |
ylabel={regex size},
|
|
|
1978 |
enlargelimits=false,
|
|
|
1979 |
xtick={0,5,...,30},
|
|
|
1980 |
xmax=33,
|
|
|
1981 |
ymax=1000,
|
|
|
1982 |
ytick={0,100,...,1000},
|
|
|
1983 |
scaled ticks=false,
|
|
|
1984 |
axis lines=left,
|
|
|
1985 |
width=5cm,
|
|
|
1986 |
height=4cm,
|
|
|
1987 |
legend entries={regex1},
|
|
|
1988 |
legend pos=north west,
|
|
|
1989 |
legend cell align=left]
|
|
|
1990 |
\addplot[red,mark=*, mark options={fill=white}] table {regex1_size_change.data};
|
|
|
1991 |
\end{axis}
|
|
|
1992 |
\end{tikzpicture}
|
|
532
|
1993 |
&
|
|
593
|
1994 |
\begin{tikzpicture}
|
|
|
1995 |
\begin{axis}[
|
|
|
1996 |
xlabel={$n$},
|
|
|
1997 |
x label style={at={(1.05,-0.05)}},
|
|
|
1998 |
%ylabel={time in secs},
|
|
|
1999 |
enlargelimits=false,
|
|
|
2000 |
xtick={0,5,...,30},
|
|
|
2001 |
xmax=33,
|
|
|
2002 |
ymax=1000,
|
|
|
2003 |
ytick={0,100,...,1000},
|
|
|
2004 |
scaled ticks=false,
|
|
|
2005 |
axis lines=left,
|
|
|
2006 |
width=5cm,
|
|
|
2007 |
height=4cm,
|
|
|
2008 |
legend entries={regex2},
|
|
|
2009 |
legend pos=north west,
|
|
|
2010 |
legend cell align=left]
|
|
|
2011 |
\addplot[blue,mark=*, mark options={fill=white}] table {regex2_size_change.data};
|
|
|
2012 |
\end{axis}
|
|
|
2013 |
\end{tikzpicture}
|
|
532
|
2014 |
&
|
|
593
|
2015 |
\begin{tikzpicture}
|
|
|
2016 |
\begin{axis}[
|
|
|
2017 |
xlabel={$n$},
|
|
|
2018 |
x label style={at={(1.05,-0.05)}},
|
|
|
2019 |
%ylabel={time in secs},
|
|
|
2020 |
enlargelimits=false,
|
|
|
2021 |
xtick={0,5,...,30},
|
|
|
2022 |
xmax=33,
|
|
|
2023 |
ymax=1000,
|
|
|
2024 |
ytick={0,100,...,1000},
|
|
|
2025 |
scaled ticks=false,
|
|
|
2026 |
axis lines=left,
|
|
|
2027 |
width=5cm,
|
|
|
2028 |
height=4cm,
|
|
|
2029 |
legend entries={regex3},
|
|
|
2030 |
legend pos=north west,
|
|
|
2031 |
legend cell align=left]
|
|
|
2032 |
\addplot[cyan,mark=*, mark options={fill=white}] table {regex3_size_change.data};
|
|
|
2033 |
\end{axis}
|
|
|
2034 |
\end{tikzpicture}\\
|
|
|
2035 |
\multicolumn{3}{c}{Graphs: size change of 3 randomly generated regular expressions $w.r.t.$ input string length.}
|
|
|
2036 |
\end{tabular}
|
|
532
|
2037 |
\end{center}
|
|
|
2038 |
\noindent
|
|
|
2039 |
Most of the regex's sizes seem to stay within a polynomial bound $w.r.t$ the
|
|
|
2040 |
original size.
|
|
591
|
2041 |
We will discuss improvements to this bound in the next chapter.
|
|
532
|
2042 |
|
|
|
2043 |
|
|
|
2044 |
|
|
|
2045 |
%----------------------------------------------------------------------------------------
|
|
|
2046 |
% SECTION ??
|
|
|
2047 |
%----------------------------------------------------------------------------------------
|
|
|
2048 |
|
|
|
2049 |
%-----------------------------------
|
|
|
2050 |
% SECTION syntactic equivalence under simp
|
|
|
2051 |
%-----------------------------------
|
|
|
2052 |
\section{Syntactic Equivalence Under $\simp$}
|
|
|
2053 |
We prove that minor differences can be annhilated
|
|
|
2054 |
by $\simp$.
|
|
|
2055 |
For example,
|
|
|
2056 |
\begin{center}
|
|
593
|
2057 |
$\simp \;(\simpALTs\; (\map \;(\_\backslash \; x)\; (\distinct \; \mathit{rs}\; \phi))) =
|
|
|
2058 |
\simp \;(\simpALTs \;(\distinct \;(\map \;(\_ \backslash\; x) \; \mathit{rs}) \; \phi))$
|
|
532
|
2059 |
\end{center}
|
|
|
2060 |
|
|
|
2061 |
|
|
|
2062 |
%----------------------------------------------------------------------------------------
|
|
|
2063 |
% SECTION ALTS CLOSED FORM
|
|
|
2064 |
%----------------------------------------------------------------------------------------
|
|
|
2065 |
\section{A Closed Form for \textit{ALTS}}
|
|
|
2066 |
Now we prove that $rsimp (rders\_simp (RALTS rs) s) = rsimp (RALTS (map (\lambda r. rders\_simp r s) rs))$.
|
|
|
2067 |
|
|
|
2068 |
|
|
|
2069 |
There are a few key steps, one of these steps is
|
|
556
|
2070 |
|
|
532
|
2071 |
|
|
|
2072 |
|
|
|
2073 |
One might want to prove this by something a simple statement like:
|
|
|
2074 |
|
|
|
2075 |
For this to hold we want the $\textit{distinct}$ function to pick up
|
|
|
2076 |
the elements before and after derivatives correctly:
|
|
|
2077 |
$r \in rset \equiv (rder x r) \in (rder x rset)$.
|
|
|
2078 |
which essentially requires that the function $\backslash$ is an injective mapping.
|
|
|
2079 |
|
|
|
2080 |
Unfortunately the function $\backslash c$ is not an injective mapping.
|
|
|
2081 |
|
|
|
2082 |
\subsection{function $\backslash c$ is not injective (1-to-1)}
|
|
|
2083 |
\begin{center}
|
|
593
|
2084 |
The derivative $w.r.t$ character $c$ is not one-to-one.
|
|
|
2085 |
Formally,
|
|
532
|
2086 |
$\exists r_1 \;r_2. r_1 \neq r_2 \mathit{and} r_1 \backslash c = r_2 \backslash c$
|
|
|
2087 |
\end{center}
|
|
|
2088 |
This property is trivially true for the
|
|
|
2089 |
character regex example:
|
|
|
2090 |
\begin{center}
|
|
|
2091 |
$r_1 = e; \; r_2 = d;\; r_1 \backslash c = \ZERO = r_2 \backslash c$
|
|
|
2092 |
\end{center}
|
|
|
2093 |
But apart from the cases where the derivative
|
|
|
2094 |
output is $\ZERO$, are there non-trivial results
|
|
|
2095 |
of derivatives which contain strings?
|
|
|
2096 |
The answer is yes.
|
|
|
2097 |
For example,
|
|
|
2098 |
\begin{center}
|
|
|
2099 |
Let $r_1 = a^*b\;\quad r_2 = (a\cdot a^*)\cdot b + b$.\\
|
|
|
2100 |
where $a$ is not nullable.\\
|
|
|
2101 |
$r_1 \backslash c = ((a \backslash c)\cdot a^*)\cdot c + b \backslash c$\\
|
|
|
2102 |
$r_2 \backslash c = ((a \backslash c)\cdot a^*)\cdot c + b \backslash c$
|
|
|
2103 |
\end{center}
|
|
576
|
2104 |
We start with two syntactically different regular expressions,
|
|
532
|
2105 |
and end up with the same derivative result.
|
|
|
2106 |
This is not surprising as we have such
|
|
|
2107 |
equality as below in the style of Arden's lemma:\\
|
|
|
2108 |
\begin{center}
|
|
|
2109 |
$L(A^*B) = L(A\cdot A^* \cdot B + B)$
|
|
|
2110 |
\end{center}
|
|
|
2111 |
|
|
590
|
2112 |
There are two problems with this finiteness result, though.
|
|
|
2113 |
\begin{itemize}
|
|
|
2114 |
\item
|
|
593
|
2115 |
First, It is not yet a direct formalisation of our lexer's complexity,
|
|
|
2116 |
as a complexity proof would require looking into
|
|
|
2117 |
the time it takes to execute {\bf all} the operations
|
|
|
2118 |
involved in the lexer (simp, collect, decode), not just the derivative.
|
|
|
2119 |
\item
|
|
|
2120 |
Second, the bound is not yet tight, and we seek to improve $N_a$ so that
|
|
|
2121 |
it is polynomial on $\llbracket a \rrbracket$.
|
|
590
|
2122 |
\end{itemize}
|
|
|
2123 |
Still, we believe this contribution is fruitful,
|
|
|
2124 |
because
|
|
|
2125 |
\begin{itemize}
|
|
|
2126 |
\item
|
|
|
2127 |
|
|
|
2128 |
The size proof can serve as a cornerstone for a complexity
|
|
|
2129 |
formalisation.
|
|
|
2130 |
Derivatives are the most important phases of our lexer algorithm.
|
|
|
2131 |
Size properties about derivatives covers the majority of the algorithm
|
|
|
2132 |
and is therefore a good indication of complexity of the entire program.
|
|
|
2133 |
\item
|
|
|
2134 |
The bound is already a strong indication that catastrophic
|
|
|
2135 |
backtracking is much less likely to occur in our $\blexersimp$
|
|
|
2136 |
algorithm.
|
|
|
2137 |
We refine $\blexersimp$ with $\blexerStrong$ in the next chapter
|
|
|
2138 |
so that the bound becomes polynomial.
|
|
|
2139 |
\end{itemize}
|
|
593
|
2140 |
|
|
532
|
2141 |
%----------------------------------------------------------------------------------------
|
|
|
2142 |
% SECTION 4
|
|
|
2143 |
%----------------------------------------------------------------------------------------
|
|
593
|
2144 |
|
|
|
2145 |
|
|
|
2146 |
|
|
|
2147 |
|
|
|
2148 |
|
|
|
2149 |
|
|
|
2150 |
|
|
|
2151 |
|
|
532
|
2152 |
One might wonder the actual bound rather than the loose bound we gave
|
|
|
2153 |
for the convenience of an easier proof.
|
|
|
2154 |
How much can the regex $r^* \backslash s$ grow?
|
|
|
2155 |
As earlier graphs have shown,
|
|
|
2156 |
%TODO: reference that graph where size grows quickly
|
|
593
|
2157 |
they can grow at a maximum speed
|
|
|
2158 |
exponential $w.r.t$ the number of characters,
|
|
532
|
2159 |
but will eventually level off when the string $s$ is long enough.
|
|
|
2160 |
If they grow to a size exponential $w.r.t$ the original regex, our algorithm
|
|
|
2161 |
would still be slow.
|
|
|
2162 |
And unfortunately, we have concrete examples
|
|
576
|
2163 |
where such regular expressions grew exponentially large before levelling off:
|
|
532
|
2164 |
$(a ^ * + (aa) ^ * + (aaa) ^ * + \ldots +
|
|
|
2165 |
(\underbrace{a \ldots a}_{\text{n a's}})^*$ will already have a maximum
|
|
593
|
2166 |
size that is exponential on the number $n$
|
|
532
|
2167 |
under our current simplification rules:
|
|
|
2168 |
%TODO: graph of a regex whose size increases exponentially.
|
|
|
2169 |
\begin{center}
|
|
593
|
2170 |
\begin{tikzpicture}
|
|
|
2171 |
\begin{axis}[
|
|
|
2172 |
height=0.5\textwidth,
|
|
|
2173 |
width=\textwidth,
|
|
|
2174 |
xlabel=number of a's,
|
|
|
2175 |
xtick={0,...,9},
|
|
|
2176 |
ylabel=maximum size,
|
|
|
2177 |
ymode=log,
|
|
|
2178 |
log basis y={2}
|
|
|
2179 |
]
|
|
|
2180 |
\addplot[mark=*,blue] table {re-chengsong.data};
|
|
|
2181 |
\end{axis}
|
|
|
2182 |
\end{tikzpicture}
|
|
532
|
2183 |
\end{center}
|
|
|
2184 |
|
|
|
2185 |
For convenience we use $(\oplus_{i=1}^{n} (\underbrace{a \ldots a}_{\text{i a's}})^*)^*$
|
|
|
2186 |
to express $(a ^ * + (aa) ^ * + (aaa) ^ * + \ldots +
|
|
|
2187 |
(\underbrace{a \ldots a}_{\text{n a's}})^*$ in the below discussion.
|
|
|
2188 |
The exponential size is triggered by that the regex
|
|
|
2189 |
$\oplus_{i=1}^{n} (\underbrace{a \ldots a}_{\text{i a's}})^*$
|
|
|
2190 |
inside the $(\ldots) ^*$ having exponentially many
|
|
|
2191 |
different derivatives, despite those difference being minor.
|
|
|
2192 |
$(\oplus_{i=1}^{n} (\underbrace{a \ldots a}_{\text{i a's}})^*)^*\backslash \underbrace{a \ldots a}_{\text{m a's}}$
|
|
|
2193 |
will therefore contain the following terms (after flattening out all nested
|
|
|
2194 |
alternatives):
|
|
|
2195 |
\begin{center}
|
|
593
|
2196 |
$(\oplus_{i = 1]{n} (\underbrace{a \ldots a}_{\text{((i - (m' \% i))\%i) a's}})\cdot (\underbrace{a \ldots a}_{\text{i a's}})^* })\cdot (\oplus_{i=1}^{n} (\underbrace{a \ldots a}_{\text{i a's}})^*)$\\
|
|
|
2197 |
$(1 \leq m' \leq m )$
|
|
532
|
2198 |
\end{center}
|
|
|
2199 |
These terms are distinct for $m' \leq L.C.M.(1, \ldots, n)$ (will be explained in appendix).
|
|
593
|
2200 |
With each new input character taking the derivative against the intermediate result, more and more such distinct
|
|
|
2201 |
terms will accumulate,
|
|
532
|
2202 |
until the length reaches $L.C.M.(1, \ldots, n)$.
|
|
|
2203 |
$\textit{distinctBy}$ will not be able to de-duplicate any two of these terms
|
|
|
2204 |
$(\oplus_{i = 1}^{n} (\underbrace{a \ldots a}_{\text{((i - (m' \% i))\%i) a's}})\cdot (\underbrace{a \ldots a}_{\text{i a's}})^* )\cdot (\oplus_{i=1}^{n} (\underbrace{a \ldots a}_{\text{i a's}})^*)^*$\\
|
|
|
2205 |
|
|
|
2206 |
$(\oplus_{i = 1}^{n} (\underbrace{a \ldots a}_{\text{((i - (m'' \% i))\%i) a's}})\cdot (\underbrace{a \ldots a}_{\text{i a's}})^* )\cdot (\oplus_{i=1}^{n} (\underbrace{a \ldots a}_{\text{i a's}})^*)^*$\\
|
|
593
|
2207 |
where $m' \neq m''$ \\
|
|
|
2208 |
as they are slightly different.
|
|
|
2209 |
This means that with our current simplification methods,
|
|
|
2210 |
we will not be able to control the derivative so that
|
|
|
2211 |
$\llbracket \bderssimp{r}{s} \rrbracket$ stays polynomial %\leq O((\llbracket r\rrbacket)^c)$
|
|
|
2212 |
as there are already exponentially many terms.
|
|
|
2213 |
These terms are similar in the sense that the head of those terms
|
|
|
2214 |
are all consisted of sub-terms of the form:
|
|
|
2215 |
$(\underbrace{a \ldots a}_{\text{j a's}})\cdot (\underbrace{a \ldots a}_{\text{i a's}})^* $.
|
|
|
2216 |
For $\oplus_{i=1}^{n} (\underbrace{a \ldots a}_{\text{i a's}})^*$, there will be at most
|
|
|
2217 |
$n * (n + 1) / 2$ such terms.
|
|
|
2218 |
For example, $(a^* + (aa)^* + (aaa)^*) ^*$'s derivatives
|
|
|
2219 |
can be described by 6 terms:
|
|
|
2220 |
$a^*$, $a\cdot (aa)^*$, $ (aa)^*$,
|
|
|
2221 |
$aa \cdot (aaa)^*$, $a \cdot (aaa)^*$, and $(aaa)^*$.
|
|
532
|
2222 |
The total number of different "head terms", $n * (n + 1) / 2$,
|
|
593
|
2223 |
is proportional to the number of characters in the regex
|
|
532
|
2224 |
$(\oplus_{i=1}^{n} (\underbrace{a \ldots a}_{\text{i a's}})^*)^*$.
|
|
|
2225 |
This suggests a slightly different notion of size, which we call the
|
|
|
2226 |
alphabetic width:
|
|
|
2227 |
%TODO:
|
|
|
2228 |
(TODO: Alphabetic width def.)
|
|
|
2229 |
|
|
593
|
2230 |
|
|
532
|
2231 |
Antimirov\parencite{Antimirov95} has proven that
|
|
|
2232 |
$\textit{PDER}_{UNIV}(r) \leq \textit{awidth}(r)$.
|
|
|
2233 |
where $\textit{PDER}_{UNIV}(r)$ is a set of all possible subterms
|
|
|
2234 |
created by doing derivatives of $r$ against all possible strings.
|
|
|
2235 |
If we can make sure that at any moment in our lexing algorithm our
|
|
|
2236 |
intermediate result hold at most one copy of each of the
|
|
|
2237 |
subterms then we can get the same bound as Antimirov's.
|
|
|
2238 |
This leads to the algorithm in the next chapter.
|
|
|
2239 |
|
|
|
2240 |
|
|
|
2241 |
|
|
|
2242 |
|
|
|
2243 |
|
|
|
2244 |
%----------------------------------------------------------------------------------------
|
|
|
2245 |
% SECTION 1
|
|
|
2246 |
%----------------------------------------------------------------------------------------
|
|
|
2247 |
|
|
|
2248 |
|
|
|
2249 |
%-----------------------------------
|
|
|
2250 |
% SUBSECTION 1
|
|
|
2251 |
%-----------------------------------
|
|
|
2252 |
\subsection{Syntactic Equivalence Under $\simp$}
|
|
|
2253 |
We prove that minor differences can be annhilated
|
|
|
2254 |
by $\simp$.
|
|
|
2255 |
For example,
|
|
|
2256 |
\begin{center}
|
|
593
|
2257 |
$\simp \;(\simpALTs\; (\map \;(\_\backslash \; x)\; (\distinct \; \mathit{rs}\; \phi))) =
|
|
|
2258 |
\simp \;(\simpALTs \;(\distinct \;(\map \;(\_ \backslash\; x) \; \mathit{rs}) \; \phi))$
|
|
532
|
2259 |
\end{center}
|
|
|
2260 |
|