|
532
|
1 |
% Chapter Template
|
|
|
2 |
|
|
|
3 |
\chapter{Finiteness Bound} % Main chapter title
|
|
|
4 |
|
|
|
5 |
\label{Finite}
|
|
|
6 |
% In Chapter 4 \ref{Chapter4} we give the second guarantee
|
|
|
7 |
%of our bitcoded algorithm, that is a finite bound on the size of any
|
|
|
8 |
%regex's derivatives.
|
|
|
9 |
|
|
618
|
10 |
|
|
624
|
11 |
In this chapter we give a bound in terms of size of
|
|
|
12 |
the calculated derivatives:
|
|
590
|
13 |
given an annotated regular expression $a$, for any string $s$
|
|
624
|
14 |
our algorithm $\blexersimp$'s derivatives
|
|
|
15 |
are finitely bounded
|
|
618
|
16 |
by a constant that only depends on $a$.
|
|
|
17 |
Formally we show that there exists an $N_a$ such that
|
|
576
|
18 |
\begin{center}
|
|
593
|
19 |
$\llbracket \bderssimp{a}{s} \rrbracket \leq N_a$
|
|
576
|
20 |
\end{center}
|
|
|
21 |
\noindent
|
|
618
|
22 |
where the size ($\llbracket \_ \rrbracket$) of
|
|
|
23 |
an annotated regular expression is defined
|
|
|
24 |
in terms of the number of nodes in its
|
|
|
25 |
tree structure (its recursive definition given in the next page).
|
|
613
|
26 |
We believe this size bound
|
|
|
27 |
is important in the context of POSIX lexing, because
|
|
590
|
28 |
\begin{itemize}
|
|
|
29 |
\item
|
|
618
|
30 |
It is a stepping stone towards the goal
|
|
|
31 |
of eliminating ``catastrophic backtracking''.
|
|
|
32 |
If the internal data structures used by our algorithm
|
|
|
33 |
grows beyond a finite bound, then clearly
|
|
|
34 |
the algorithm (which traverses these structures) will
|
|
|
35 |
be slow.
|
|
624
|
36 |
The next step is to refine the bound $N_a$ so that it
|
|
|
37 |
is not just finite but polynomial in $\llbracket a\rrbracket$.
|
|
590
|
38 |
\item
|
|
618
|
39 |
Having the finite bound formalised
|
|
|
40 |
gives us a higher confidence that
|
|
590
|
41 |
our simplification algorithm $\simp$ does not ``mis-behave''
|
|
|
42 |
like $\simpsulz$ does.
|
|
618
|
43 |
The bound is universal for a given regular expression,
|
|
|
44 |
which is an advantage over work which
|
|
624
|
45 |
only gives empirical evidence on
|
|
|
46 |
some test cases (see Verbatim++ work\cite{Verbatimpp}).
|
|
590
|
47 |
\end{itemize}
|
|
625
|
48 |
\noindent
|
|
|
49 |
We then extend our $\blexersimp$
|
|
|
50 |
to support bounded repetitions ($r^{\{n\}}$).
|
|
|
51 |
We update our formalisation of
|
|
|
52 |
the correctness and finiteness properties to
|
|
|
53 |
include this new construct.
|
|
|
54 |
we can out-compete other verified lexers such as
|
|
|
55 |
Verbatim++ on bounded regular expressions.
|
|
|
56 |
|
|
618
|
57 |
In the next section we describe in more detail
|
|
|
58 |
what the finite bound means in our algorithm
|
|
|
59 |
and why the size of the internal data structures of
|
|
|
60 |
a typical derivative-based lexer such as
|
|
|
61 |
Sulzmann and Lu's need formal treatment.
|
|
|
62 |
|
|
625
|
63 |
|
|
|
64 |
|
|
|
65 |
|
|
576
|
66 |
\section{Formalising About Size}
|
|
577
|
67 |
\noindent
|
|
613
|
68 |
In our lexer ($\blexersimp$),
|
|
|
69 |
we take an annotated regular expression as input,
|
|
618
|
70 |
and repeately take derivative of and simplify it.
|
|
|
71 |
\begin{figure}
|
|
|
72 |
\begin{center}
|
|
|
73 |
\begin{tabular}{lcl}
|
|
|
74 |
$\llbracket _{bs}\ONE \rrbracket$ & $\dn$ & $1$\\
|
|
|
75 |
$\llbracket \ZERO \rrbracket$ & $\dn$ & $1$ \\
|
|
|
76 |
$\llbracket _{bs} r_1 \cdot r_2 \rrbracket$ & $\dn$ & $\llbracket r_1 \rrbracket + \llbracket r_2 \rrbracket + 1$\\
|
|
|
77 |
$\llbracket _{bs}\mathbf{c} \rrbracket $ & $\dn$ & $1$\\
|
|
|
78 |
$\llbracket _{bs}\sum as \rrbracket $ & $\dn$ & $\map \; (\llbracket \_ \rrbracket)\; as + 1$\\
|
|
|
79 |
$\llbracket _{bs} a^* \rrbracket $ & $\dn$ & $\llbracket a \rrbracket + 1$.
|
|
|
80 |
\end{tabular}
|
|
|
81 |
\end{center}
|
|
|
82 |
\caption{The size function of bitcoded regular expressions}\label{brexpSize}
|
|
|
83 |
\end{figure}
|
|
|
84 |
|
|
|
85 |
\begin{figure}
|
|
593
|
86 |
\begin{tikzpicture}[scale=2,
|
|
|
87 |
every node/.style={minimum size=11mm},
|
|
|
88 |
->,>=stealth',shorten >=1pt,auto,thick
|
|
|
89 |
]
|
|
|
90 |
\node (r0) [rectangle, draw=black, thick, minimum size = 5mm, draw=blue] {$a$};
|
|
|
91 |
\node (r1) [rectangle, draw=black, thick, right=of r0, minimum size = 7mm]{$a_1$};
|
|
|
92 |
\draw[->,line width=0.2mm](r0)--(r1) node[above,midway] {$\backslash c_1$};
|
|
590
|
93 |
|
|
593
|
94 |
\node (r1s) [rectangle, draw=blue, thick, right=of r1, minimum size=6mm]{$a_{1s}$};
|
|
|
95 |
\draw[->, line width=0.2mm](r1)--(r1s) node[above, midway] {$\simp$};
|
|
590
|
96 |
|
|
593
|
97 |
\node (r2) [rectangle, draw=black, thick, right=of r1s, minimum size = 12mm]{$a_2$};
|
|
|
98 |
\draw[->,line width=0.2mm](r1s)--(r2) node[above,midway] {$\backslash c_2$};
|
|
590
|
99 |
|
|
593
|
100 |
\node (r2s) [rectangle, draw = blue, thick, right=of r2,minimum size=6mm]{$a_{2s}$};
|
|
|
101 |
\draw[->,line width=0.2mm](r2)--(r2s) node[above,midway] {$\simp$};
|
|
590
|
102 |
|
|
593
|
103 |
\node (rns) [rectangle, draw = blue, thick, right=of r2s,minimum size=6mm]{$a_{ns}$};
|
|
|
104 |
\draw[->,line width=0.2mm, dashed](r2s)--(rns) node[above,midway] {$\backslash \ldots$};
|
|
590
|
105 |
|
|
593
|
106 |
\node (v) [circle, thick, draw, right=of rns, minimum size=6mm, right=1.7cm]{$v$};
|
|
|
107 |
\draw[->, line width=0.2mm](rns)--(v) node[above, midway] {\bmkeps} node [below, midway] {\decode};
|
|
|
108 |
\end{tikzpicture}
|
|
|
109 |
\caption{Regular expression size change during our $\blexersimp$ algorithm}\label{simpShrinks}
|
|
590
|
110 |
\end{figure}
|
|
618
|
111 |
|
|
576
|
112 |
\noindent
|
|
590
|
113 |
Each time
|
|
613
|
114 |
a derivative is taken, the regular expression might grow.
|
|
|
115 |
However, the simplification that is immediately afterwards will always shrink it so that
|
|
618
|
116 |
it stays relatively small.
|
|
577
|
117 |
This intuition is depicted by the relative size
|
|
590
|
118 |
change between the black and blue nodes:
|
|
|
119 |
After $\simp$ the node always shrinks.
|
|
618
|
120 |
Our proof states that all the blue nodes
|
|
613
|
121 |
stay below a size bound $N_a$ determined by the input $a$.
|
|
576
|
122 |
|
|
590
|
123 |
\noindent
|
|
613
|
124 |
Sulzmann and Lu's assumed a similar picture about their algorithm,
|
|
590
|
125 |
though in fact their algorithm's size might be better depicted by the following graph:
|
|
|
126 |
\begin{figure}[H]
|
|
593
|
127 |
\begin{tikzpicture}[scale=2,
|
|
|
128 |
every node/.style={minimum size=11mm},
|
|
|
129 |
->,>=stealth',shorten >=1pt,auto,thick
|
|
|
130 |
]
|
|
|
131 |
\node (r0) [rectangle, draw=black, thick, minimum size = 5mm, draw=blue] {$a$};
|
|
|
132 |
\node (r1) [rectangle, draw=black, thick, right=of r0, minimum size = 7mm]{$a_1$};
|
|
|
133 |
\draw[->,line width=0.2mm](r0)--(r1) node[above,midway] {$\backslash c_1$};
|
|
590
|
134 |
|
|
593
|
135 |
\node (r1s) [rectangle, draw=blue, thick, right=of r1, minimum size=7mm]{$a_{1s}$};
|
|
|
136 |
\draw[->, line width=0.2mm](r1)--(r1s) node[above, midway] {$\simp'$};
|
|
590
|
137 |
|
|
593
|
138 |
\node (r2) [rectangle, draw=black, thick, right=of r1s, minimum size = 17mm]{$a_2$};
|
|
|
139 |
\draw[->,line width=0.2mm](r1s)--(r2) node[above,midway] {$\backslash c_2$};
|
|
590
|
140 |
|
|
593
|
141 |
\node (r2s) [rectangle, draw = blue, thick, right=of r2,minimum size=14mm]{$a_{2s}$};
|
|
|
142 |
\draw[->,line width=0.2mm](r2)--(r2s) node[above,midway] {$\simp'$};
|
|
590
|
143 |
|
|
593
|
144 |
\node (r3) [rectangle, draw = black, thick, right= of r2s, minimum size = 22mm]{$a_3$};
|
|
|
145 |
\draw[->,line width=0.2mm](r2s)--(r3) node[above,midway] {$\backslash c_3$};
|
|
590
|
146 |
|
|
593
|
147 |
\node (rns) [right = of r3, draw=blue, minimum size = 20mm]{$a_{3s}$};
|
|
|
148 |
\draw[->,line width=0.2mm] (r3)--(rns) node [above, midway] {$\simp'$};
|
|
590
|
149 |
|
|
593
|
150 |
\node (rnn) [right = of rns, minimum size = 1mm]{};
|
|
|
151 |
\draw[->, dashed] (rns)--(rnn) node [above, midway] {$\ldots$};
|
|
590
|
152 |
|
|
593
|
153 |
\end{tikzpicture}
|
|
|
154 |
\caption{Regular expression size change during our $\blexersimp$ algorithm}\label{sulzShrinks}
|
|
590
|
155 |
\end{figure}
|
|
|
156 |
\noindent
|
|
613
|
157 |
The picture means that on certain cases their lexer (where they use $\simpsulz$
|
|
|
158 |
as the simplification function)
|
|
618
|
159 |
will have a size explosion, causing the running time
|
|
613
|
160 |
of each derivative step to grow continuously (for example
|
|
590
|
161 |
in \ref{SulzmannLuLexerTime}).
|
|
613
|
162 |
They tested out the run time of their
|
|
590
|
163 |
lexer on particular examples such as $(a+b+ab)^*$
|
|
613
|
164 |
and claimed that their algorithm is linear w.r.t to the input.
|
|
|
165 |
With our mecahnised proof, we avoid this type of unintentional
|
|
|
166 |
generalisation.\\
|
|
|
167 |
|
|
|
168 |
Before delving in to the details of the formalisation,
|
|
|
169 |
we are going to provide an overview of it.
|
|
618
|
170 |
In the next subsection, we give a high-level view
|
|
613
|
171 |
of the proof.
|
|
|
172 |
|
|
590
|
173 |
|
|
577
|
174 |
\subsection{Overview of the Proof}
|
|
618
|
175 |
A high-level overview of the main components of the finiteness proof
|
|
|
176 |
is as follows:
|
|
593
|
177 |
\begin{figure}[H]
|
|
|
178 |
\begin{tikzpicture}[scale=1,font=\bf,
|
|
|
179 |
node/.style={
|
|
|
180 |
rectangle,rounded corners=3mm,
|
|
|
181 |
ultra thick,draw=black!50,minimum height=18mm,
|
|
|
182 |
minimum width=20mm,
|
|
|
183 |
top color=white,bottom color=black!20}]
|
|
543
|
184 |
|
|
|
185 |
|
|
593
|
186 |
\node (0) at (-5,0)
|
|
|
187 |
[node, text width=1.8cm, text centered]
|
|
|
188 |
{$\llbracket \bderssimp{a}{s} \rrbracket$};
|
|
|
189 |
\node (A) at (0,0)
|
|
|
190 |
[node,text width=1.6cm, text centered]
|
|
|
191 |
{$\llbracket \rderssimp{r}{s} \rrbracket_r$};
|
|
|
192 |
\node (B) at (3,0)
|
|
|
193 |
[node,text width=3.0cm, anchor=west, minimum width = 40mm]
|
|
|
194 |
{$\llbracket \textit{ClosedForm}(r, s)\rrbracket_r$};
|
|
|
195 |
\node (C) at (9.5,0) [node, minimum width=10mm] {$N_r$};
|
|
|
196 |
|
|
|
197 |
\draw [->,line width=0.5mm] (0) --
|
|
|
198 |
node [above,pos=0.45] {=} (A) node [below, pos = 0.45] {$(r = a \downarrow_r)$} (A);
|
|
|
199 |
\draw [->,line width=0.5mm] (A) --
|
|
|
200 |
node [above,pos=0.35] {$\quad =\ldots=$} (B);
|
|
|
201 |
\draw [->,line width=0.5mm] (B) --
|
|
|
202 |
node [above,pos=0.35] {$\quad \leq \ldots \leq$} (C);
|
|
|
203 |
\end{tikzpicture}
|
|
|
204 |
%\caption{
|
|
|
205 |
\end{figure}
|
|
576
|
206 |
\noindent
|
|
577
|
207 |
We explain the steps one by one:
|
|
532
|
208 |
\begin{itemize}
|
|
590
|
209 |
\item
|
|
|
210 |
We first introduce the operations such as
|
|
|
211 |
derivatives, simplification, size calculation, etc.
|
|
618
|
212 |
associated with $\rrexp$s, which we have introduced
|
|
|
213 |
in chapter \ref{Bitcoded2}.
|
|
593
|
214 |
The operations on $\rrexp$s are identical to those on
|
|
618
|
215 |
annotated regular expressions except that they dispense with
|
|
|
216 |
bitcodes. This means that all proofs about size of $\rrexp$s will apply to
|
|
|
217 |
annotated regular expressions, because the size of a regular
|
|
|
218 |
expression is independent of the bitcodes.
|
|
590
|
219 |
\item
|
|
593
|
220 |
We prove that $\rderssimp{r}{s} = \textit{ClosedForm}(r, s)$,
|
|
|
221 |
where $\textit{ClosedForm}(r, s)$ is entirely
|
|
618
|
222 |
given as the derivatives of their children regular
|
|
593
|
223 |
expressions.
|
|
|
224 |
We call the right-hand-side the \emph{Closed Form}
|
|
|
225 |
of the derivative $\rderssimp{r}{s}$.
|
|
590
|
226 |
\item
|
|
618
|
227 |
Formally we give an estimate of
|
|
|
228 |
$\llbracket \textit{ClosedForm}(r, s) \rrbracket_r$.
|
|
593
|
229 |
The key observation is that $\distinctBy$'s output is
|
|
|
230 |
a list with a constant length bound.
|
|
532
|
231 |
\end{itemize}
|
|
594
|
232 |
We will expand on these steps in the next sections.\\
|
|
532
|
233 |
|
|
613
|
234 |
\section{The $\textit{Rrexp}$ Datatype}
|
|
594
|
235 |
The first step is to define
|
|
|
236 |
$\textit{rrexp}$s.
|
|
618
|
237 |
They are annotated regular expressions without bitcodes,
|
|
594
|
238 |
allowing a much simpler size bound proof.
|
|
618
|
239 |
%Of course, the bits which encode the lexing information
|
|
|
240 |
%would grow linearly with respect
|
|
|
241 |
%to the input, which should be taken into account when we wish to tackle the runtime comlexity.
|
|
|
242 |
%But for the sake of the structural size
|
|
|
243 |
%we can safely ignore them.\\
|
|
|
244 |
The datatype
|
|
594
|
245 |
definition of the $\rrexp$, called
|
|
593
|
246 |
\emph{r-regular expressions},
|
|
594
|
247 |
was initially defined in \ref{rrexpDef}.
|
|
|
248 |
The reason for the prefix $r$ is
|
|
593
|
249 |
to make a distinction
|
|
594
|
250 |
with basic regular expressions.
|
|
576
|
251 |
\[ \rrexp ::= \RZERO \mid \RONE
|
|
593
|
252 |
\mid \RCHAR{c}
|
|
|
253 |
\mid \RSEQ{r_1}{r_2}
|
|
|
254 |
\mid \RALTS{rs}
|
|
|
255 |
\mid \RSTAR{r}
|
|
576
|
256 |
\]
|
|
593
|
257 |
The size of an r-regular expression is
|
|
|
258 |
written $\llbracket r\rrbracket_r$,
|
|
|
259 |
whose definition mirrors that of an annotated regular expression.
|
|
576
|
260 |
\begin{center}
|
|
618
|
261 |
\begin{tabular}{lcl}
|
|
593
|
262 |
$\llbracket _{bs}\ONE \rrbracket_r$ & $\dn$ & $1$\\
|
|
|
263 |
$\llbracket \ZERO \rrbracket_r$ & $\dn$ & $1$ \\
|
|
|
264 |
$\llbracket _{bs} r_1 \cdot r_2 \rrbracket_r$ & $\dn$ & $\llbracket r_1 \rrbracket_r + \llbracket r_2 \rrbracket_r + 1$\\
|
|
|
265 |
$\llbracket _{bs}\mathbf{c} \rrbracket_r $ & $\dn$ & $1$\\
|
|
|
266 |
$\llbracket _{bs}\sum as \rrbracket_r $ & $\dn$ & $\map \; (\llbracket \_ \rrbracket_r)\; as + 1$\\
|
|
|
267 |
$\llbracket _{bs} a^* \rrbracket_r $ & $\dn$ & $\llbracket a \rrbracket_r + 1$.
|
|
|
268 |
\end{tabular}
|
|
576
|
269 |
\end{center}
|
|
|
270 |
\noindent
|
|
593
|
271 |
The $r$ in the subscript of $\llbracket \rrbracket_r$ is to
|
|
|
272 |
differentiate with the same operation for annotated regular expressions.
|
|
|
273 |
Adding $r$ as subscript will be used in
|
|
594
|
274 |
other operations as well.\\
|
|
593
|
275 |
The transformation from an annotated regular expression
|
|
|
276 |
to an r-regular expression is straightforward.
|
|
|
277 |
\begin{center}
|
|
|
278 |
\begin{tabular}{lcl}
|
|
|
279 |
$\rerase{\ZERO}$ & $\dn$ & $\RZERO$\\
|
|
|
280 |
$\rerase{_{bs}\ONE}$ & $\dn$ & $\RONE$\\
|
|
|
281 |
$\rerase{_{bs}\mathbf{c}}$ & $\dn$ & $\RCHAR{c}$\\
|
|
|
282 |
$\rerase{_{bs}r_1\cdot r_2}$ & $\dn$ & $\RSEQ{\rerase{r_1}}{\rerase{r_2}}$\\
|
|
|
283 |
$\rerase{_{bs}\sum as}$ & $\dn$ & $\RALTS{\map \; \rerase{\_} \; as}$\\
|
|
|
284 |
$\rerase{_{bs} a ^*}$ & $\dn$ & $\rerase{a} ^*$
|
|
|
285 |
\end{tabular}
|
|
|
286 |
\end{center}
|
|
594
|
287 |
|
|
613
|
288 |
\subsection{Why a New Datatype?}
|
|
618
|
289 |
The reason we
|
|
|
290 |
define a new datatype is that
|
|
|
291 |
the $\erase$ function
|
|
|
292 |
does not preserve the structure of annotated
|
|
|
293 |
regular expressions.
|
|
576
|
294 |
We initially started by using
|
|
|
295 |
plain regular expressions and tried to prove
|
|
618
|
296 |
lemma \ref{rsizeAsize},
|
|
|
297 |
however the $\erase$ function messes with the structure of the
|
|
594
|
298 |
annotated regular expression.
|
|
|
299 |
The $+$ constructor
|
|
618
|
300 |
of basic regular expressions is only binary, whereas $\sum$
|
|
|
301 |
takes a list. Therefore we need to convert between
|
|
|
302 |
annotated and normal regular expressions as follows:
|
|
576
|
303 |
\begin{center}
|
|
618
|
304 |
\begin{tabular}{lcl}
|
|
594
|
305 |
$\erase \; _{bs}\sum [] $ & $\dn$ & $\ZERO$\\
|
|
|
306 |
$\erase \; _{bs}\sum [a]$ & $\dn$ & $a$\\
|
|
|
307 |
$\erase \; _{bs}\sum a :: as$ & $\dn$ & $a + (\erase \; _{[]} \sum as)\quad \text{if $as$ length over 1}$
|
|
|
308 |
\end{tabular}
|
|
576
|
309 |
\end{center}
|
|
594
|
310 |
\noindent
|
|
618
|
311 |
As can be seen alternative regular expression with an empty argument list
|
|
594
|
312 |
will be turned into a $\ZERO$.
|
|
618
|
313 |
The singleton alternative $\sum [r]$ becomes $r$ during the
|
|
594
|
314 |
$\erase$ function.
|
|
|
315 |
The annotated regular expression $\sum[a, b, c]$ would turn into
|
|
|
316 |
$(a+(b+c))$.
|
|
|
317 |
All these operations change the size and structure of
|
|
|
318 |
an annotated regular expressions, adding unnecessary
|
|
|
319 |
complexities to the size bound proof.\\
|
|
613
|
320 |
For example, if we define the size of a basic plain regular expression
|
|
594
|
321 |
in the usual way,
|
|
543
|
322 |
\begin{center}
|
|
618
|
323 |
\begin{tabular}{lcl}
|
|
593
|
324 |
$\llbracket \ONE \rrbracket_p$ & $\dn$ & $1$\\
|
|
|
325 |
$\llbracket \ZERO \rrbracket_p$ & $\dn$ & $1$ \\
|
|
|
326 |
$\llbracket r_1 \cdot r_2 \rrbracket_p$ & $\dn$ & $\llbracket r_1 \rrbracket_p + \llbracket r_2 \rrbracket_p + 1$\\
|
|
|
327 |
$\llbracket \mathbf{c} \rrbracket_p $ & $\dn$ & $1$\\
|
|
|
328 |
$\llbracket r_1 \cdot r_2 \rrbracket_p $ & $\dn$ & $\llbracket r_1 \rrbracket_p \; + \llbracket r_2 \rrbracket_p + 1$\\
|
|
|
329 |
$\llbracket a^* \rrbracket_p $ & $\dn$ & $\llbracket a \rrbracket_p + 1$
|
|
|
330 |
\end{tabular}
|
|
532
|
331 |
\end{center}
|
|
543
|
332 |
\noindent
|
|
594
|
333 |
Then the property
|
|
532
|
334 |
\begin{center}
|
|
613
|
335 |
$\llbracket a \rrbracket \stackrel{?}{=} \llbracket a_\downarrow \rrbracket_p$
|
|
532
|
336 |
\end{center}
|
|
594
|
337 |
does not hold.
|
|
613
|
338 |
With $\textit{rerase}$, however,
|
|
|
339 |
only the bitcodes are thrown away.
|
|
|
340 |
Everything about the structure remains intact.
|
|
|
341 |
Therefore it does not change the size
|
|
618
|
342 |
of an annotated regular expression and we have:
|
|
613
|
343 |
\begin{lemma}\label{rsizeAsize}
|
|
|
344 |
$\rsize{\rerase a} = \asize a$
|
|
|
345 |
\end{lemma}
|
|
|
346 |
\begin{proof}
|
|
|
347 |
By routine structural induction on $a$.
|
|
|
348 |
\end{proof}
|
|
|
349 |
\noindent
|
|
594
|
350 |
One might be able to prove an inequality such as
|
|
|
351 |
$\llbracket a \rrbracket \leq \llbracket a_\downarrow \rrbracket_p $
|
|
|
352 |
and then estimate $\llbracket a_\downarrow \rrbracket_p$,
|
|
|
353 |
but we found our approach more straightforward.\\
|
|
532
|
354 |
|
|
613
|
355 |
\subsection{Functions for R-regular Expressions}
|
|
618
|
356 |
In this section we shall define the r-regular expression version
|
|
|
357 |
of $\blexer$, and $\blexersimp$ related functions.
|
|
613
|
358 |
We use $r$ as the prefix or subscript to differentiate
|
|
|
359 |
with the bitcoded version.
|
|
618
|
360 |
%For example,$\backslash_r$, $\rdistincts$, and $\rsimp$
|
|
|
361 |
%as opposed to $\backslash$, $\distinctBy$, and $\bsimp$.
|
|
|
362 |
%As promised, they are much simpler than their bitcoded counterparts.
|
|
613
|
363 |
%The operations on r-regular expressions are
|
|
|
364 |
%almost identical to those of the annotated regular expressions,
|
|
|
365 |
%except that no bitcodes are used. For example,
|
|
618
|
366 |
The derivative operation for an r-regular expression is\\
|
|
543
|
367 |
\begin{center}
|
|
593
|
368 |
\begin{tabular}{@{}lcl@{}}
|
|
|
369 |
$(\ZERO)\,\backslash_r c$ & $\dn$ & $\ZERO$\\
|
|
|
370 |
$(\ONE)\,\backslash_r c$ & $\dn$ &
|
|
|
371 |
$\textit{if}\;c=d\; \;\textit{then}\;
|
|
|
372 |
\ONE\;\textit{else}\;\ZERO$\\
|
|
|
373 |
$(\sum \;\textit{rs})\,\backslash_r c$ & $\dn$ &
|
|
|
374 |
$\sum\;(\textit{map} \; (\_\backslash_r c) \; rs )$\\
|
|
|
375 |
$(r_1\cdot r_2)\,\backslash_r c$ & $\dn$ &
|
|
594
|
376 |
$\textit{if}\;(\textit{rnullable}\,r_1)$\\
|
|
593
|
377 |
& &$\textit{then}\;\sum\,[(r_1\,\backslash_r c)\cdot\,r_2,$\\
|
|
|
378 |
& &$\phantom{\textit{then},\;\sum\,}((r_2\,\backslash_r c))]$\\
|
|
|
379 |
& &$\textit{else}\;\,(r_1\,\backslash_r c)\cdot r_2$\\
|
|
|
380 |
$(r^*)\,\backslash_r c$ & $\dn$ &
|
|
|
381 |
$( r\,\backslash_r c)\cdot
|
|
|
382 |
(_{[]}r^*))$
|
|
|
383 |
\end{tabular}
|
|
543
|
384 |
\end{center}
|
|
|
385 |
\noindent
|
|
618
|
386 |
where we omit the definition of $\textit{rnullable}$.
|
|
620
|
387 |
The generalisation from derivative w.r.t to character to
|
|
|
388 |
derivative w.r.t string is given as
|
|
|
389 |
\begin{center}
|
|
|
390 |
\begin{tabular}{lcl}
|
|
|
391 |
$r \backslash_{rs} []$ & $\dn$ & $r$\\
|
|
|
392 |
$r \backslash_{rs} c::s$ & $\dn$ & $(r\backslash_r c) \backslash_{rs} s$
|
|
|
393 |
\end{tabular}
|
|
|
394 |
\end{center}
|
|
618
|
395 |
|
|
|
396 |
The function $\distinctBy$ for r-regular expressions does not need
|
|
594
|
397 |
a function checking equivalence because
|
|
618
|
398 |
there are no bit annotations.
|
|
|
399 |
Therefore we have
|
|
532
|
400 |
\begin{center}
|
|
593
|
401 |
\begin{tabular}{lcl}
|
|
|
402 |
$\rdistinct{[]}{rset} $ & $\dn$ & $[]$\\
|
|
594
|
403 |
$\rdistinct{r :: rs}{rset}$ & $\dn$ &
|
|
|
404 |
$\textit{if}(r \in \textit{rset}) \; \textit{then} \; \rdistinct{rs}{rset}$\\
|
|
|
405 |
& & $\textit{else}\; \;
|
|
|
406 |
r::\rdistinct{rs}{(rset \cup \{r\})}$
|
|
593
|
407 |
\end{tabular}
|
|
532
|
408 |
\end{center}
|
|
|
409 |
%TODO: definition of rsimp (maybe only the alternative clause)
|
|
543
|
410 |
\noindent
|
|
618
|
411 |
%We would like to make clear
|
|
|
412 |
%a difference between our $\rdistincts$ and
|
|
|
413 |
%the Isabelle $\textit {distinct}$ predicate.
|
|
|
414 |
%In Isabelle $\textit{distinct}$ is a function that returns a boolean
|
|
|
415 |
%rather than a list.
|
|
|
416 |
%It tests if all the elements of a list are unique.\\
|
|
|
417 |
With $\textit{rdistinct}$ in place,
|
|
|
418 |
the flatten function for $\rrexp$ is as follows:
|
|
595
|
419 |
\begin{center}
|
|
|
420 |
\begin{tabular}{@{}lcl@{}}
|
|
596
|
421 |
$\textit{rflts} \; (\sum \textit{as}) :: \textit{as'}$ & $\dn$ & $as \; @ \; \textit{rflts} \; as' $ \\
|
|
595
|
422 |
$\textit{rflts} \; \ZERO :: as'$ & $\dn$ & $ \textit{rflts} \; \textit{as'} $ \\
|
|
|
423 |
$\textit{rflts} \; a :: as'$ & $\dn$ & $a :: \textit{rflts} \; \textit{as'}$ \quad(otherwise)
|
|
|
424 |
\end{tabular}
|
|
|
425 |
\end{center}
|
|
|
426 |
\noindent
|
|
618
|
427 |
The function
|
|
|
428 |
$\rsimpalts$ corresponds to $\textit{bsimp}_{ALTS}$:
|
|
596
|
429 |
\begin{center}
|
|
|
430 |
\begin{tabular}{@{}lcl@{}}
|
|
|
431 |
$\rsimpalts \;\; nil$ & $\dn$ & $\RZERO$\\
|
|
|
432 |
$\rsimpalts \;\; r::nil$ & $\dn$ & $r$\\
|
|
|
433 |
$\rsimpalts \;\; rs$ & $\dn$ & $\sum rs$\\
|
|
|
434 |
\end{tabular}
|
|
|
435 |
\end{center}
|
|
|
436 |
\noindent
|
|
618
|
437 |
Similarly, we have $\rsimpseq$ which corresponds to $\textit{bsimp}_{SEQ}$:
|
|
596
|
438 |
\begin{center}
|
|
|
439 |
\begin{tabular}{@{}lcl@{}}
|
|
|
440 |
$\rsimpseq \;\; \RZERO \; \_ $ & $=$ & $\RZERO$\\
|
|
|
441 |
$\rsimpseq \;\; \_ \; \RZERO $ & $=$ & $\RZERO$\\
|
|
|
442 |
$\rsimpseq \;\; \RONE \cdot r_2$ & $\dn$ & $r_2$\\
|
|
|
443 |
$\rsimpseq \;\; r_1 r_2$ & $\dn$ & $r_1 \cdot r_2$\\
|
|
|
444 |
\end{tabular}
|
|
|
445 |
\end{center}
|
|
|
446 |
and get $\textit{rsimp}$ and $\rderssimp{\_}{\_}$:
|
|
595
|
447 |
\begin{center}
|
|
|
448 |
\begin{tabular}{@{}lcl@{}}
|
|
|
449 |
|
|
596
|
450 |
$\textit{rsimp} \; (r_1\cdot r_2)$ & $\dn$ & $ \textit{rsimp}_{SEQ} \; bs \;(\textit{rsimp} \; r_1) \; (\textit{rsimp} \; r_2) $ \\
|
|
|
451 |
$\textit{rsimp} \; (_{bs}\sum \textit{rs})$ & $\dn$ & $\textit{rsimp}_{ALTS} \; \textit{bs} \; (\textit{rdistinct} \; ( \textit{rflts} ( \textit{map} \; rsimp \; rs)) \; \rerases \; \varnothing) $ \\
|
|
|
452 |
$\textit{rsimp} \; r$ & $\dn$ & $\textit{r} \qquad \textit{otherwise}$
|
|
595
|
453 |
\end{tabular}
|
|
|
454 |
\end{center}
|
|
596
|
455 |
\begin{center}
|
|
|
456 |
\begin{tabular}{@{}lcl@{}}
|
|
|
457 |
$r\backslash_{rsimp} \, c$ & $\dn$ & $\rsimp \; (r\backslash_r \, c)$
|
|
|
458 |
\end{tabular}
|
|
|
459 |
\end{center}
|
|
|
460 |
|
|
|
461 |
\begin{center}
|
|
|
462 |
\begin{tabular}{@{}lcl@{}}
|
|
601
|
463 |
$r \backslash_{rsimps} \; \; c\!::\!s $ & $\dn$ & $(r \backslash_{rsimp}\, c) \backslash_{rsimps}\, s$ \\
|
|
596
|
464 |
$r \backslash_{rsimps} [\,] $ & $\dn$ & $r$
|
|
|
465 |
\end{tabular}
|
|
|
466 |
\end{center}
|
|
|
467 |
\noindent
|
|
601
|
468 |
We do not define an r-regular expression version of $\blexersimp$,
|
|
618
|
469 |
as our proof does not depend on it.
|
|
613
|
470 |
Now we are ready to introduce how r-regular expressions allow
|
|
|
471 |
us to prove the size bound on bitcoded regular expressions.
|
|
|
472 |
|
|
|
473 |
\subsection{Using R-regular Expressions to Bound Bit-coded Regular Expressions}
|
|
|
474 |
Everything about the size of annotated regular expressions after the application
|
|
|
475 |
of function $\bsimp$ and $\backslash_{simps}$
|
|
|
476 |
can be calculated via the size of r-regular expressions after the application
|
|
|
477 |
of $\rsimp$ and $\backslash_{rsimps}$:
|
|
564
|
478 |
\begin{lemma}\label{sizeRelations}
|
|
618
|
479 |
The following two equalities hold:
|
|
543
|
480 |
\begin{itemize}
|
|
|
481 |
\item
|
|
601
|
482 |
$\asize{\bsimps \; a} = \rsize{\rsimp{ \rerase{a}}}$
|
|
554
|
483 |
\item
|
|
596
|
484 |
$\asize{\bderssimp{a}{s}} = \rsize{\rderssimp{\rerase{a}}{s}}$
|
|
554
|
485 |
\end{itemize}
|
|
532
|
486 |
\end{lemma}
|
|
601
|
487 |
\begin{proof}
|
|
|
488 |
The first part is by induction on the inductive cases
|
|
|
489 |
of $\textit{bsimp}$.
|
|
|
490 |
The second part is by induction on the string $s$,
|
|
|
491 |
where the inductive step follows from part one.
|
|
|
492 |
\end{proof}
|
|
543
|
493 |
\noindent
|
|
596
|
494 |
With lemma \ref{sizeRelations},
|
|
601
|
495 |
we will be able to focus on
|
|
|
496 |
estimating only
|
|
|
497 |
$\rsize{\rderssimp{\rerase{a}}{s}}$
|
|
|
498 |
in later parts because
|
|
|
499 |
\begin{center}
|
|
|
500 |
$\rsize{\rderssimp{\rerase{a}}{s}} \leq N_r \quad$
|
|
|
501 |
implies
|
|
|
502 |
$\quad \llbracket a \backslash_{bsimps} s \rrbracket \leq N_r$.
|
|
|
503 |
\end{center}
|
|
618
|
504 |
%From now on we
|
|
|
505 |
%Unless stated otherwise in the rest of this
|
|
|
506 |
%chapter all regular expressions without
|
|
|
507 |
%bitcodes are seen as r-regular expressions ($\rrexp$s).
|
|
|
508 |
%For the binary alternative r-regular expression $\RALTS{[r_1, r_2]}$,
|
|
|
509 |
%we use the notation $r_1 + r_2$
|
|
|
510 |
%for brevity.
|
|
532
|
511 |
|
|
|
512 |
|
|
|
513 |
%-----------------------------------
|
|
596
|
514 |
% SUB SECTION ROADMAP RREXP BOUND
|
|
532
|
515 |
%-----------------------------------
|
|
553
|
516 |
|
|
596
|
517 |
%\subsection{Roadmap to a Bound for $\textit{Rrexp}$}
|
|
553
|
518 |
|
|
596
|
519 |
%The way we obtain the bound for $\rrexp$s is by two steps:
|
|
|
520 |
%\begin{itemize}
|
|
|
521 |
% \item
|
|
|
522 |
% First, we rewrite $r\backslash s$ into something else that is easier
|
|
|
523 |
% to bound. This step is especially important for the inductive case
|
|
|
524 |
% $r_1 \cdot r_2$ and $r^*$, where the derivative can grow and bloat in a wild way,
|
|
|
525 |
% but after simplification they will always be equal or smaller to a form consisting of an alternative
|
|
|
526 |
% list of regular expressions $f \; (g\; (\sum rs))$ with some functions applied to it, where each element will be distinct after the function application.
|
|
|
527 |
% \item
|
|
|
528 |
% Then, for such a sum list of regular expressions $f\; (g\; (\sum rs))$, we can control its size
|
|
|
529 |
% by estimation, since $\distinctBy$ and $\flts$ are well-behaved and working together would only
|
|
|
530 |
% reduce the size of a regular expression, not adding to it.
|
|
|
531 |
%\end{itemize}
|
|
|
532 |
%
|
|
|
533 |
%\section{Step One: Closed Forms}
|
|
|
534 |
%We transform the function application $\rderssimp{r}{s}$
|
|
|
535 |
%into an equivalent
|
|
|
536 |
%form $f\; (g \; (\sum rs))$.
|
|
|
537 |
%The functions $f$ and $g$ can be anything from $\flts$, $\distinctBy$ and other helper functions from $\bsimp{\_}$.
|
|
|
538 |
%This way we get a different but equivalent way of expressing : $r\backslash s = f \; (g\; (\sum rs))$, we call the
|
|
|
539 |
%right hand side the "closed form" of $r\backslash s$.
|
|
|
540 |
%
|
|
|
541 |
%\begin{quote}\it
|
|
|
542 |
% Claim: For regular expressions $r_1 \cdot r_2$, we claim that
|
|
|
543 |
%\end{quote}
|
|
|
544 |
%\noindent
|
|
|
545 |
%We explain in detail how we reached those claims.
|
|
601
|
546 |
If we attempt to prove
|
|
|
547 |
\begin{center}
|
|
609
|
548 |
$\forall r. \; \exists N_r.\;\; s.t. \llbracket r\backslash_{rsimps} s \rrbracket_r \leq N_r$
|
|
601
|
549 |
\end{center}
|
|
|
550 |
using a naive induction on the structure of $r$,
|
|
|
551 |
then we are stuck at the inductive cases such as
|
|
|
552 |
$r_1\cdot r_2$.
|
|
|
553 |
The inductive hypotheses are:
|
|
|
554 |
\begin{center}
|
|
|
555 |
1: $\text{for } r_1, \text{there exists } N_{r_1}.\;\; s.t.
|
|
609
|
556 |
\;\;\forall s. \llbracket r_1 \backslash_{rsimps} s \rrbracket_r \leq N_{r_1}. $\\
|
|
601
|
557 |
2: $\text{for } r_2, \text{there exists } N_{r_2}.\;\; s.t.
|
|
609
|
558 |
\;\; \forall s. \llbracket r_2 \backslash_{rsimps} s \rrbracket_r \leq N_{r_2}. $
|
|
601
|
559 |
\end{center}
|
|
|
560 |
The inductive step to prove would be
|
|
|
561 |
\begin{center}
|
|
|
562 |
$\text{there exists } N_{r_1\cdot r_2}. \;\; s.t. \forall s.
|
|
609
|
563 |
\llbracket (r_1 \cdot r_2) \backslash_{rsimps} s \rrbracket_r \leq N_{r_1\cdot r_2}.$
|
|
601
|
564 |
\end{center}
|
|
|
565 |
The problem is that it is not clear what
|
|
609
|
566 |
$(r_1\cdot r_2) \backslash_{rsimps} s$ looks like,
|
|
601
|
567 |
and therefore $N_{r_1}$ and $N_{r_2}$ in the
|
|
|
568 |
inductive hypotheses cannot be directly used.
|
|
618
|
569 |
%We have already seen that $(r_1 \cdot r_2)\backslash s$
|
|
|
570 |
%and $(r^*)\backslash s$ can grow in a wild way.
|
|
613
|
571 |
|
|
618
|
572 |
The point however, is that they will be equivalent to a list of
|
|
609
|
573 |
terms $\sum rs$, where each term in $rs$ will
|
|
|
574 |
be made of $r_1 \backslash s' $, $r_2\backslash s'$,
|
|
618
|
575 |
and $r \backslash s'$ with $s' \in \textit{SubString} \; s$ (which stands
|
|
|
576 |
for the set of substrings of $s$).
|
|
609
|
577 |
The list $\sum rs$ will then be de-duplicated by $\textit{rdistinct}$
|
|
618
|
578 |
in the simplification, which prevents the $rs$ from growing indefinitely.
|
|
609
|
579 |
|
|
613
|
580 |
Based on this idea, we develop a proof in two steps.
|
|
|
581 |
First, we show the equality (where
|
|
609
|
582 |
$f$ and $g$ are functions that do not increase the size of the input)
|
|
|
583 |
\begin{center}
|
|
613
|
584 |
$r\backslash_{rsimps} s = f\; (\textit{rdistinct} \; (g\; \sum rs))$,
|
|
609
|
585 |
\end{center}
|
|
613
|
586 |
where $r = r_1 \cdot r_2$ or $r = r_0^*$ and so on.
|
|
|
587 |
For example, for $r_1 \cdot r_2$ we have the equality as
|
|
|
588 |
\begin{center}
|
|
|
589 |
$ \rderssimp{r_1 \cdot r_2}{s} =
|
|
|
590 |
\rsimp{(\sum (r_1 \backslash s \cdot r_2 ) \; :: \;(\map \; \rderssimp{r2}{\_} \;(\vsuf{s}{r_1})))}$
|
|
|
591 |
\end{center}
|
|
609
|
592 |
We call the right-hand-side the
|
|
|
593 |
\emph{Closed Form} of $(r_1 \cdot r_2)\backslash_{rsimps} s$.
|
|
613
|
594 |
Second, we will bound the closed form of r-regular expressions
|
|
|
595 |
using some estimation techniques
|
|
618
|
596 |
and then apply
|
|
|
597 |
lemma \ref{sizeRelations} to show that the bitcoded regular expressions
|
|
613
|
598 |
in our $\blexersimp$ are finitely bounded.
|
|
609
|
599 |
|
|
618
|
600 |
We will describe in detail the first step of the proof
|
|
|
601 |
in the next section.
|
|
613
|
602 |
|
|
|
603 |
\section{Closed Forms}
|
|
609
|
604 |
In this section we introduce in detail
|
|
618
|
605 |
how we express the string derivatives
|
|
|
606 |
of regular expressions (i.e. $r \backslash_r s$ where $s$ is a string
|
|
|
607 |
rather than a single character) in a different way than
|
|
|
608 |
our previous definition.
|
|
|
609 |
In previous chapters, the derivative of a
|
|
|
610 |
regular expression $r$ w.r.t a string $s$
|
|
|
611 |
was recursively defined on the string:
|
|
|
612 |
\begin{center}
|
|
|
613 |
$r \backslash_s (c::s) \dn (r \backslash c) \backslash_s s$
|
|
|
614 |
\end{center}
|
|
|
615 |
The problem is that
|
|
|
616 |
this definition does not provide much information
|
|
|
617 |
on what $r \backslash_s s$ looks like.
|
|
|
618 |
If we are interested in the size of a derivative like
|
|
|
619 |
$(r_1 \cdot r_2)\backslash s$,
|
|
|
620 |
we have to somehow get a more concrete form to begin.
|
|
|
621 |
We call such more concrete representations the ``closed forms'' of
|
|
|
622 |
string derivatives as opposed to their original definitions.
|
|
|
623 |
The terminology ``closed form'' is borrowed from mathematics,
|
|
|
624 |
which usually describe expressions that are solely comprised of
|
|
|
625 |
well-known and easy-to-compute operations such as
|
|
|
626 |
additions, multiplications, exponential functions.
|
|
|
627 |
|
|
613
|
628 |
We start by proving some basic identities
|
|
609
|
629 |
involving the simplification functions for r-regular expressions.
|
|
613
|
630 |
After that we introduce the rewrite relations
|
|
|
631 |
$\rightsquigarrow_h$, $\rightsquigarrow^*_{scf}$
|
|
|
632 |
$\rightsquigarrow_f$ and $\rightsquigarrow_g$.
|
|
618
|
633 |
These relations involves similar techniques as in chapter \ref{Bitcoded2}
|
|
|
634 |
for annotated regular expressions.
|
|
613
|
635 |
Finally, we use these identities to establish the
|
|
|
636 |
closed forms of the alternative regular expression,
|
|
|
637 |
the sequence regular expression, and the star regular expression.
|
|
609
|
638 |
%$r_1\cdot r_2$, $r^*$ and $\sum rs$.
|
|
601
|
639 |
|
|
|
640 |
|
|
609
|
641 |
|
|
613
|
642 |
\subsection{Some Basic Identities}
|
|
609
|
643 |
|
|
618
|
644 |
In what follows we will often convert between lists
|
|
|
645 |
and sets.
|
|
|
646 |
We use Isabelle's $set$ to refere to the
|
|
611
|
647 |
function that converts a list $rs$ to the set
|
|
|
648 |
containing all the elements in $rs$.
|
|
|
649 |
\subsubsection{$\textit{rdistinct}$'s Does the Job of De-duplication}
|
|
543
|
650 |
The $\textit{rdistinct}$ function, as its name suggests, will
|
|
613
|
651 |
de-duplicate an r-regular expression list.
|
|
|
652 |
It will also remove any elements that
|
|
|
653 |
is already in the accumulator set.
|
|
555
|
654 |
\begin{lemma}\label{rdistinctDoesTheJob}
|
|
609
|
655 |
%The function $\textit{rdistinct}$ satisfies the following
|
|
|
656 |
%properties:
|
|
|
657 |
Assume we have the predicate $\textit{isDistinct}$\footnote{We omit its
|
|
618
|
658 |
recursive definition here. Its Isabelle counterpart would be $\textit{distinct}$.}
|
|
609
|
659 |
for testing
|
|
613
|
660 |
whether a list's elements are unique. Then the following
|
|
609
|
661 |
properties about $\textit{rdistinct}$ hold:
|
|
543
|
662 |
\begin{itemize}
|
|
|
663 |
\item
|
|
|
664 |
If $a \in acc$ then $a \notin (\rdistinct{rs}{acc})$.
|
|
|
665 |
\item
|
|
609
|
666 |
%If list $rs'$ is the result of $\rdistinct{rs}{acc}$,
|
|
|
667 |
$\textit{isDistinct} \;\;\; (\rdistinct{rs}{acc})$.
|
|
555
|
668 |
\item
|
|
609
|
669 |
$\textit{set} \; (\rdistinct{rs}{acc})
|
|
|
670 |
= (textit{set} \; rs) - acc$
|
|
543
|
671 |
\end{itemize}
|
|
|
672 |
\end{lemma}
|
|
555
|
673 |
\noindent
|
|
543
|
674 |
\begin{proof}
|
|
|
675 |
The first part is by an induction on $rs$.
|
|
555
|
676 |
The second and third part can be proven by using the
|
|
609
|
677 |
inductive cases of $\textit{rdistinct}$.
|
|
593
|
678 |
|
|
543
|
679 |
\end{proof}
|
|
|
680 |
|
|
|
681 |
\noindent
|
|
613
|
682 |
%$\textit{rdistinct}$ will out all regular expression terms
|
|
|
683 |
%that are in the accumulator, therefore
|
|
|
684 |
Concatenating a list $rs_a$ at the front of another
|
|
|
685 |
list $rs$ whose elements are all from the accumulator, and then calling $\textit{rdistinct}$
|
|
|
686 |
on the merged list, the output will be as if we had called $\textit{rdistinct}$
|
|
543
|
687 |
without the prepending of $rs$:
|
|
609
|
688 |
\begin{lemma}\label{rdistinctConcat}
|
|
554
|
689 |
The elements appearing in the accumulator will always be removed.
|
|
|
690 |
More precisely,
|
|
|
691 |
\begin{itemize}
|
|
|
692 |
\item
|
|
|
693 |
If $rs \subseteq rset$, then
|
|
|
694 |
$\rdistinct{rs@rsa }{acc} = \rdistinct{rsa }{acc}$.
|
|
|
695 |
\item
|
|
609
|
696 |
More generally, if $a \in rset$ and $\rdistinct{rs}{\{a\}} = []$,
|
|
554
|
697 |
then $\rdistinct{(rs @ rs')}{rset} = \rdistinct{rs'}{rset}$
|
|
|
698 |
\end{itemize}
|
|
543
|
699 |
\end{lemma}
|
|
554
|
700 |
|
|
543
|
701 |
\begin{proof}
|
|
609
|
702 |
By induction on $rs$ and using \ref{rdistinctDoesTheJob}.
|
|
543
|
703 |
\end{proof}
|
|
|
704 |
\noindent
|
|
|
705 |
On the other hand, if an element $r$ does not appear in the input list waiting to be deduplicated,
|
|
|
706 |
then expanding the accumulator to include that element will not cause the output list to change:
|
|
611
|
707 |
\begin{lemma}\label{rdistinctOnDistinct}
|
|
543
|
708 |
The accumulator can be augmented to include elements not appearing in the input list,
|
|
|
709 |
and the output will not change.
|
|
|
710 |
\begin{itemize}
|
|
|
711 |
\item
|
|
611
|
712 |
If $r \notin rs$, then $\rdistinct{rs}{acc} = \rdistinct{rs}{(\{r\} \cup acc)}$.
|
|
543
|
713 |
\item
|
|
611
|
714 |
Particularly, if $\;\;\textit{isDistinct} \; rs$, then we have\\
|
|
543
|
715 |
\[ \rdistinct{rs}{\varnothing} = rs \]
|
|
|
716 |
\end{itemize}
|
|
|
717 |
\end{lemma}
|
|
|
718 |
\begin{proof}
|
|
|
719 |
The first half is by induction on $rs$. The second half is a corollary of the first.
|
|
|
720 |
\end{proof}
|
|
|
721 |
\noindent
|
|
611
|
722 |
The function $\textit{rdistinct}$ removes duplicates from anywhere in a list.
|
|
|
723 |
Despite being seemingly obvious,
|
|
|
724 |
the induction technique is not as straightforward.
|
|
554
|
725 |
\begin{lemma}\label{distinctRemovesMiddle}
|
|
|
726 |
The two properties hold if $r \in rs$:
|
|
|
727 |
\begin{itemize}
|
|
|
728 |
\item
|
|
555
|
729 |
$\rdistinct{rs}{rset} = \rdistinct{(rs @ [r])}{rset}$\\
|
|
|
730 |
and\\
|
|
554
|
731 |
$\rdistinct{(ab :: rs @ [ab])}{rset'} = \rdistinct{(ab :: rs)}{rset'}$
|
|
|
732 |
\item
|
|
555
|
733 |
$\rdistinct{ (rs @ rs') }{rset} = \rdistinct{rs @ [r] @ rs'}{rset}$\\
|
|
|
734 |
and\\
|
|
554
|
735 |
$\rdistinct{(ab :: rs @ [ab] @ rs'')}{rset'} =
|
|
593
|
736 |
\rdistinct{(ab :: rs @ rs'')}{rset'}$
|
|
554
|
737 |
\end{itemize}
|
|
|
738 |
\end{lemma}
|
|
|
739 |
\noindent
|
|
|
740 |
\begin{proof}
|
|
593
|
741 |
By induction on $rs$. All other variables are allowed to be arbitrary.
|
|
611
|
742 |
The second part of the lemma requires the first.
|
|
618
|
743 |
Note that for each part, the two sub-propositions need to be proven
|
|
|
744 |
at the same time,
|
|
593
|
745 |
so that the induction goes through.
|
|
554
|
746 |
\end{proof}
|
|
555
|
747 |
\noindent
|
|
611
|
748 |
This allows us to prove a few more equivalence relations involving
|
|
618
|
749 |
$\textit{rdistinct}$ (they will be useful later):
|
|
555
|
750 |
\begin{lemma}\label{rdistinctConcatGeneral}
|
|
611
|
751 |
\mbox{}
|
|
555
|
752 |
\begin{itemize}
|
|
|
753 |
\item
|
|
|
754 |
$\rdistinct{(rs @ rs')}{\varnothing} = \rdistinct{((\rdistinct{rs}{\varnothing})@ rs')}{\varnothing}$
|
|
|
755 |
\item
|
|
|
756 |
$\rdistinct{(rs @ rs')}{\varnothing} = \rdistinct{(\rdistinct{rs}{\varnothing} @ rs')}{\varnothing}$
|
|
|
757 |
\item
|
|
|
758 |
If $rset' \subseteq rset$, then $\rdistinct{rs}{rset} =
|
|
|
759 |
\rdistinct{(\rdistinct{rs}{rset'})}{rset}$. As a corollary
|
|
|
760 |
of this,
|
|
|
761 |
\item
|
|
|
762 |
$\rdistinct{(rs @ rs')}{rset} = \rdistinct{
|
|
|
763 |
(\rdistinct{rs}{\varnothing}) @ rs')}{rset}$. This
|
|
|
764 |
gives another corollary use later:
|
|
|
765 |
\item
|
|
|
766 |
If $a \in rset$, then $\rdistinct{(rs @ rs')}{rset} = \rdistinct{
|
|
|
767 |
(\rdistinct{(a :: rs)}{\varnothing} @ rs')}{rset} $,
|
|
|
768 |
|
|
|
769 |
\end{itemize}
|
|
|
770 |
\end{lemma}
|
|
|
771 |
\begin{proof}
|
|
|
772 |
By \ref{rdistinctDoesTheJob} and \ref{distinctRemovesMiddle}.
|
|
|
773 |
\end{proof}
|
|
611
|
774 |
\noindent
|
|
613
|
775 |
The next lemma is a more general form of \ref{rdistinctConcat},
|
|
|
776 |
it says that
|
|
611
|
777 |
$\textit{rdistinct}$ is composable w.r.t list concatenation:
|
|
|
778 |
\begin{lemma}\label{distinctRdistinctAppend}
|
|
|
779 |
If $\;\; \textit{isDistinct} \; rs_1$,
|
|
|
780 |
and $(set \; rs_1) \cap acc = \varnothing$,
|
|
|
781 |
then applying $\textit{rdistinct}$ on $rs_1 @ rs_a$ does not
|
|
|
782 |
have an effect on $rs_1$:
|
|
|
783 |
\[\textit{rdistinct}\; (rs_1 @ rsa)\;\, acc
|
|
|
784 |
= rs_1@(\textit{rdistinct} rsa \; (acc \cup rs_1))\]
|
|
|
785 |
\end{lemma}
|
|
|
786 |
\begin{proof}
|
|
|
787 |
By an induction on
|
|
|
788 |
$rs_1$, where $rsa$ and $acc$ are allowed to be arbitrary.
|
|
|
789 |
\end{proof}
|
|
|
790 |
\noindent
|
|
|
791 |
$\textit{rdistinct}$ needs to be applied only once, and
|
|
618
|
792 |
applying it multiple times does not make any difference:
|
|
611
|
793 |
\begin{corollary}\label{distinctOnceEnough}
|
|
|
794 |
$\textit{rdistinct} \; (rs @ rsa) {} = \textit{rdistinct} \; (rdistinct \;
|
|
|
795 |
rs \{ \} @ (\textit{rdistinct} \; rs_a \; (set \; rs)))$
|
|
|
796 |
\end{corollary}
|
|
|
797 |
\begin{proof}
|
|
|
798 |
By lemma \ref{distinctRdistinctAppend}.
|
|
|
799 |
\end{proof}
|
|
555
|
800 |
|
|
611
|
801 |
\subsubsection{The Properties of $\textit{Rflts}$}
|
|
|
802 |
We give in this subsection some properties
|
|
620
|
803 |
involving $\backslash_r$, $\backslash_{rsimps}$, $\textit{rflts}$ and
|
|
611
|
804 |
$\textit{rsimp}_{ALTS} $, together with any non-trivial lemmas that lead to them.
|
|
543
|
805 |
These will be helpful in later closed form proofs, when
|
|
611
|
806 |
we want to transform derivative terms which have
|
|
|
807 |
%the ways in which multiple functions involving
|
|
|
808 |
%those are composed together
|
|
|
809 |
interleaving derivatives and simplifications applied to them.
|
|
543
|
810 |
|
|
611
|
811 |
\noindent
|
|
|
812 |
%When the function $\textit{Rflts}$
|
|
|
813 |
%is applied to the concatenation of two lists, the output can be calculated by first applying the
|
|
|
814 |
%functions on two lists separately, and then concatenating them together.
|
|
|
815 |
$\textit{Rflts}$ is composable in terms of concatenation:
|
|
554
|
816 |
\begin{lemma}\label{rfltsProps}
|
|
618
|
817 |
The function $\rflts$ has the properties below:\\
|
|
543
|
818 |
\begin{itemize}
|
|
|
819 |
\item
|
|
554
|
820 |
$\rflts \; (rs_1 @ rs_2) = \rflts \; rs_1 @ \rflts \; rs_2$
|
|
|
821 |
\item
|
|
|
822 |
If $r \neq \RZERO$ and $\nexists rs_1. r = \RALTS{rs}_1$, then $\rflts \; (r::rs) = r :: \rflts \; rs$
|
|
|
823 |
\item
|
|
|
824 |
$\rflts \; (rs @ [\RZERO]) = \rflts \; rs$
|
|
|
825 |
\item
|
|
|
826 |
$\rflts \; (rs' @ [\RALTS{rs}]) = \rflts \; rs'@rs$
|
|
|
827 |
\item
|
|
|
828 |
$\rflts \; (rs @ [\RONE]) = \rflts \; rs @ [\RONE]$
|
|
|
829 |
\item
|
|
|
830 |
If $r \neq \RZERO$ and $\nexists rs'. r = \RALTS{rs'}$ then $\rflts \; (rs @ [r])
|
|
|
831 |
= (\rflts \; rs) @ [r]$
|
|
555
|
832 |
\item
|
|
|
833 |
If $r = \RALTS{rs}$ and $r \in rs'$ then for all $r_1 \in rs.
|
|
|
834 |
r_1 \in \rflts \; rs'$.
|
|
|
835 |
\item
|
|
|
836 |
$\rflts \; (rs_a @ \RZERO :: rs_b) = \rflts \; (rs_a @ rs_b)$
|
|
543
|
837 |
\end{itemize}
|
|
|
838 |
\end{lemma}
|
|
|
839 |
\noindent
|
|
|
840 |
\begin{proof}
|
|
555
|
841 |
By induction on $rs_1$ in the first sub-lemma, and induction on $r$ in the second part,
|
|
|
842 |
and induction on $rs$, $rs'$, $rs$, $rs'$, $rs_a$ in the third, fourth, fifth, sixth and
|
|
|
843 |
last sub-lemma.
|
|
543
|
844 |
\end{proof}
|
|
611
|
845 |
\noindent
|
|
|
846 |
Now we introduce the property that the operations
|
|
|
847 |
derivative and $\rsimpalts$
|
|
618
|
848 |
commute, this will be used later on, when deriving the closed form for
|
|
611
|
849 |
the alternative regular expression:
|
|
|
850 |
\begin{lemma}\label{rderRsimpAltsCommute}
|
|
|
851 |
$\rder{x}{(\rsimpalts \; rs)} = \rsimpalts \; (\map \; (\rder{x}{\_}) \; rs)$
|
|
|
852 |
\end{lemma}
|
|
618
|
853 |
\begin{proof}
|
|
|
854 |
By induction on $rs$.
|
|
|
855 |
\end{proof}
|
|
611
|
856 |
\noindent
|
|
614
|
857 |
|
|
|
858 |
\subsubsection{The $RL$ Function: Language Interpretation of $\textit{Rrexp}$s}
|
|
618
|
859 |
Much like the definition of $L$ on plain regular expressions, one can also
|
|
614
|
860 |
define the language interpretation of $\rrexp$s.
|
|
|
861 |
\begin{center}
|
|
|
862 |
\begin{tabular}{lcl}
|
|
|
863 |
$RL \; (\ZERO)$ & $\dn$ & $\phi$\\
|
|
|
864 |
$RL \; (\ONE)$ & $\dn$ & $\{[]\}$\\
|
|
|
865 |
$RL \; (c)$ & $\dn$ & $\{[c]\}$\\
|
|
|
866 |
$RL \; \sum rs$ & $\dn$ & $ \bigcup_{r \in rs} (RL \; r)$\\
|
|
|
867 |
$RL \; (r_1 \cdot r_2)$ & $\dn$ & $ RL \; (r_1) @ RL \; (r_2)$\\
|
|
|
868 |
$RL \; (r^*)$ & $\dn$ & $ (RL(r))^*$
|
|
|
869 |
\end{tabular}
|
|
|
870 |
\end{center}
|
|
|
871 |
\noindent
|
|
|
872 |
The main use of $RL$ is to establish some connections between $\rsimp{}$
|
|
|
873 |
and $\rnullable{}$:
|
|
|
874 |
\begin{lemma}
|
|
|
875 |
The following properties hold:
|
|
|
876 |
\begin{itemize}
|
|
|
877 |
\item
|
|
|
878 |
If $\rnullable{r}$, then $\rsimp{r} \neq \RZERO$.
|
|
|
879 |
\item
|
|
|
880 |
$\rnullable{r \backslash s} \quad $ if and only if $\quad \rnullable{\rderssimp{r}{s}}$.
|
|
|
881 |
\end{itemize}
|
|
|
882 |
\end{lemma}
|
|
|
883 |
\begin{proof}
|
|
|
884 |
The first part is by induction on $r$.
|
|
|
885 |
The second part is true because property
|
|
|
886 |
\[ RL \; r = RL \; (\rsimp{r})\] holds.
|
|
|
887 |
\end{proof}
|
|
|
888 |
|
|
|
889 |
\subsubsection{Simplified $\textit{Rrexp}$s are Good}
|
|
|
890 |
We formalise the notion of ``good" regular expressions,
|
|
|
891 |
which means regular expressions that
|
|
618
|
892 |
are fully simplified in terms of our $\textit{rsimp}$ function.
|
|
|
893 |
For alternative regular expressions that means they
|
|
|
894 |
do not contain any nested alternatives, un-eliminated $\RZERO$s
|
|
|
895 |
or duplicate elements (for example,
|
|
|
896 |
$r_1 + (r_2 + r_3)$, $\RZERO + r$ and $ \sum [r, r, \ldots]$).
|
|
|
897 |
The clauses for $\good$ are:
|
|
614
|
898 |
\begin{center}
|
|
|
899 |
\begin{tabular}{@{}lcl@{}}
|
|
|
900 |
$\good\; \RZERO$ & $\dn$ & $\textit{false}$\\
|
|
|
901 |
$\good\; \RONE$ & $\dn$ & $\textit{true}$\\
|
|
|
902 |
$\good\; \RCHAR{c}$ & $\dn$ & $\btrue$\\
|
|
|
903 |
$\good\; \RALTS{[]}$ & $\dn$ & $\bfalse$\\
|
|
|
904 |
$\good\; \RALTS{[r]}$ & $\dn$ & $\bfalse$\\
|
|
|
905 |
$\good\; \RALTS{r_1 :: r_2 :: rs}$ & $\dn$ &
|
|
|
906 |
$\textit{isDistinct} \; (r_1 :: r_2 :: rs) \;$\\
|
|
618
|
907 |
& & $\land \; (\forall r' \in (r_1 :: r_2 :: rs).\; \good \; r'\; \, \land \; \, \textit{nonAlt}\; r')$\\
|
|
614
|
908 |
$\good \; \RSEQ{\RZERO}{r}$ & $\dn$ & $\bfalse$\\
|
|
|
909 |
$\good \; \RSEQ{\RONE}{r}$ & $\dn$ & $\bfalse$\\
|
|
|
910 |
$\good \; \RSEQ{r}{\RZERO}$ & $\dn$ & $\bfalse$\\
|
|
|
911 |
$\good \; \RSEQ{r_1}{r_2}$ & $\dn$ & $\good \; r_1 \;\, \textit{and} \;\, \good \; r_2$\\
|
|
|
912 |
$\good \; \RSTAR{r}$ & $\dn$ & $\btrue$\\
|
|
|
913 |
\end{tabular}
|
|
|
914 |
\end{center}
|
|
|
915 |
\noindent
|
|
618
|
916 |
We omit the recursive definition of the predicate $\textit{nonAlt}$,
|
|
|
917 |
which evaluates to true when the regular expression is not an
|
|
614
|
918 |
alternative, and false otherwise.
|
|
|
919 |
The $\good$ property is preserved under $\rsimp_{ALTS}$, provided that
|
|
|
920 |
its non-empty argument list of expressions are all good themsleves, and $\textit{nonAlt}$,
|
|
|
921 |
and unique:
|
|
|
922 |
\begin{lemma}\label{rsimpaltsGood}
|
|
|
923 |
If $rs \neq []$ and forall $r \in rs. \textit{nonAlt} \; r$ and $\textit{isDistinct} \; rs$,
|
|
|
924 |
then $\good \; (\rsimpalts \; rs)$ if and only if forall $r \in rs. \; \good \; r$.
|
|
|
925 |
\end{lemma}
|
|
|
926 |
\noindent
|
|
|
927 |
We also note that
|
|
|
928 |
if a regular expression $r$ is good, then $\rflts$ on the singleton
|
|
|
929 |
list $[r]$ will not break goodness:
|
|
|
930 |
\begin{lemma}\label{flts2}
|
|
|
931 |
If $\good \; r$, then forall $r' \in \rflts \; [r]. \; \good \; r'$ and $\textit{nonAlt} \; r'$.
|
|
|
932 |
\end{lemma}
|
|
|
933 |
\begin{proof}
|
|
|
934 |
By an induction on $r$.
|
|
|
935 |
\end{proof}
|
|
|
936 |
\noindent
|
|
|
937 |
The other observation we make about $\rsimp{r}$ is that it never
|
|
|
938 |
comes with nested alternatives, which we describe as the $\nonnested$
|
|
|
939 |
property:
|
|
|
940 |
\begin{center}
|
|
|
941 |
\begin{tabular}{lcl}
|
|
|
942 |
$\nonnested \; \, \sum []$ & $\dn$ & $\btrue$\\
|
|
|
943 |
$\nonnested \; \, \sum ((\sum rs_1) :: rs_2)$ & $\dn$ & $\bfalse$\\
|
|
|
944 |
$\nonnested \; \, \sum (r :: rs)$ & $\dn$ & $\nonnested (\sum rs)$\\
|
|
|
945 |
$\nonnested \; \, r $ & $\dn$ & $\btrue$
|
|
|
946 |
\end{tabular}
|
|
|
947 |
\end{center}
|
|
|
948 |
\noindent
|
|
|
949 |
The $\rflts$ function
|
|
|
950 |
always opens up nested alternatives,
|
|
|
951 |
which enables $\rsimp$ to be non-nested:
|
|
|
952 |
|
|
|
953 |
\begin{lemma}\label{nonnestedRsimp}
|
|
618
|
954 |
It is always the case that
|
|
|
955 |
\begin{center}
|
|
|
956 |
$\nonnested \; (\rsimp{r})$
|
|
|
957 |
\end{center}
|
|
614
|
958 |
\end{lemma}
|
|
|
959 |
\begin{proof}
|
|
618
|
960 |
By induction on $r$.
|
|
614
|
961 |
\end{proof}
|
|
|
962 |
\noindent
|
|
|
963 |
With this we could prove that a regular expressions
|
|
|
964 |
after simplification and flattening and de-duplication,
|
|
|
965 |
will not contain any alternative regular expression directly:
|
|
|
966 |
\begin{lemma}\label{nonaltFltsRd}
|
|
|
967 |
If $x \in \rdistinct{\rflts\; (\map \; \rsimp{} \; rs)}{\varnothing}$
|
|
|
968 |
then $\textit{nonAlt} \; x$.
|
|
|
969 |
\end{lemma}
|
|
|
970 |
\begin{proof}
|
|
|
971 |
By \ref{nonnestedRsimp}.
|
|
|
972 |
\end{proof}
|
|
|
973 |
\noindent
|
|
618
|
974 |
The other fact we know is that once $\rsimp{}$ has finished
|
|
614
|
975 |
processing an alternative regular expression, it will not
|
|
618
|
976 |
contain any $\RZERO$s. This is because all the recursive
|
|
614
|
977 |
calls to the simplification on the children regular expressions
|
|
618
|
978 |
make the children good, and $\rflts$ will not delete
|
|
614
|
979 |
any $\RZERO$s out of a good regular expression list,
|
|
618
|
980 |
and $\rdistinct{}$ will not ``mess'' with the result.
|
|
614
|
981 |
\begin{lemma}\label{flts3Obv}
|
|
|
982 |
The following are true:
|
|
|
983 |
\begin{itemize}
|
|
|
984 |
\item
|
|
|
985 |
If for all $r \in rs. \, \good \; r $ or $r = \RZERO$,
|
|
|
986 |
then for all $r \in \rflts\; rs. \, \good \; r$.
|
|
|
987 |
\item
|
|
|
988 |
If $x \in \rdistinct{\rflts\; (\map \; rsimp{}\; rs)}{\varnothing}$
|
|
|
989 |
and for all $y$ such that $\llbracket y \rrbracket_r$ less than
|
|
|
990 |
$\llbracket rs \rrbracket_r + 1$, either
|
|
|
991 |
$\good \; (\rsimp{y})$ or $\rsimp{y} = \RZERO$,
|
|
|
992 |
then $\good \; x$.
|
|
|
993 |
\end{itemize}
|
|
|
994 |
\end{lemma}
|
|
|
995 |
\begin{proof}
|
|
|
996 |
The first part is by induction on $rs$, where the induction
|
|
|
997 |
rule is the inductive cases for $\rflts$.
|
|
|
998 |
The second part is a corollary from the first part.
|
|
|
999 |
\end{proof}
|
|
|
1000 |
|
|
|
1001 |
And this leads to good structural property of $\rsimp{}$,
|
|
|
1002 |
that after simplification, a regular expression is
|
|
|
1003 |
either good or $\RZERO$:
|
|
|
1004 |
\begin{lemma}\label{good1}
|
|
|
1005 |
For any r-regular expression $r$, $\good \; \rsimp{r}$ or $\rsimp{r} = \RZERO$.
|
|
|
1006 |
\end{lemma}
|
|
|
1007 |
\begin{proof}
|
|
|
1008 |
By an induction on $r$. The inductive measure is the size $\llbracket \rrbracket_r$.
|
|
618
|
1009 |
Lemma \ref{rsimpMono} says that
|
|
614
|
1010 |
$\llbracket \rsimp{r}\rrbracket_r$ is smaller than or equal to
|
|
|
1011 |
$\llbracket r \rrbracket_r$.
|
|
|
1012 |
Therefore, in the $r_1 \cdot r_2$ and $\sum rs$ case,
|
|
|
1013 |
Inductive hypothesis applies to the children regular expressions
|
|
|
1014 |
$r_1$, $r_2$, etc. The lemma \ref{flts3Obv}'s precondition is satisfied
|
|
|
1015 |
by that as well.
|
|
|
1016 |
The lemmas \ref{nonnestedRsimp} and \ref{nonaltFltsRd} are used
|
|
|
1017 |
to ensure that goodness is preserved at the topmost level.
|
|
|
1018 |
\end{proof}
|
|
|
1019 |
We shall prove that any good regular expression is
|
|
|
1020 |
a fixed-point for $\rsimp{}$.
|
|
|
1021 |
First we prove an auxiliary lemma:
|
|
|
1022 |
\begin{lemma}\label{goodaltsNonalt}
|
|
|
1023 |
If $\good \; \sum rs$, then $\rflts\; rs = rs$.
|
|
|
1024 |
\end{lemma}
|
|
|
1025 |
\begin{proof}
|
|
|
1026 |
By an induction on $\sum rs$. The inductive rules are the cases
|
|
|
1027 |
for $\good$.
|
|
|
1028 |
\end{proof}
|
|
|
1029 |
\noindent
|
|
|
1030 |
Now we are ready to prove that good regular expressions are invariant
|
|
618
|
1031 |
with respect to $\rsimp{}$:
|
|
614
|
1032 |
\begin{lemma}\label{test}
|
|
|
1033 |
If $\good \;r$ then $\rsimp{r} = r$.
|
|
|
1034 |
\end{lemma}
|
|
|
1035 |
\begin{proof}
|
|
|
1036 |
By an induction on the inductive cases of $\good$, using lemmas
|
|
|
1037 |
\ref{goodaltsNonalt} and \ref{rdistinctOnDistinct}.
|
|
|
1038 |
The lemma \ref{goodaltsNonalt} is used in the alternative
|
|
|
1039 |
case where 2 or more elements are present in the list.
|
|
|
1040 |
\end{proof}
|
|
|
1041 |
\noindent
|
|
618
|
1042 |
Given below is a property involving $\rflts$, $\textit{rdistinct}$,
|
|
|
1043 |
$\rsimp{}$ and $\rsimp_{ALTS}$,
|
|
|
1044 |
which requires $\ref{good1}$ to go through smoothly:
|
|
614
|
1045 |
\begin{lemma}\label{flattenRsimpalts}
|
|
618
|
1046 |
An application of $\rsimp_{ALTS}$ can be ``absorbed'',
|
|
|
1047 |
if its output is concatenated with a list and then applied to $\rflts$.
|
|
|
1048 |
\begin{center}
|
|
614
|
1049 |
$\rflts \; ( (\rsimp_{ALTS} \;
|
|
|
1050 |
(\rdistinct{(\rflts \; (\map \; \rsimp{}\; rs))}{\varnothing})) ::
|
|
|
1051 |
\map \; \rsimp{} \; rs' ) =
|
|
|
1052 |
\rflts \; ( (\rdistinct{(\rflts \; (\map \; \rsimp{}\; rs))}{\varnothing}) @ (
|
|
|
1053 |
\map \; \rsimp{rs'}))$
|
|
618
|
1054 |
\end{center}
|
|
614
|
1055 |
|
|
|
1056 |
|
|
|
1057 |
\end{lemma}
|
|
|
1058 |
\begin{proof}
|
|
|
1059 |
By \ref{good1}.
|
|
|
1060 |
\end{proof}
|
|
|
1061 |
\noindent
|
|
|
1062 |
|
|
|
1063 |
|
|
|
1064 |
|
|
|
1065 |
|
|
|
1066 |
|
|
|
1067 |
We are also ready to prove that $\textit{rsimp}$ is idempotent.
|
|
|
1068 |
\subsubsection{$\rsimp$ is Idempotent}
|
|
|
1069 |
The idempotency of $\rsimp$ is very useful in
|
|
|
1070 |
manipulating regular expression terms into desired
|
|
|
1071 |
forms so that key steps allowing further rewriting to closed forms
|
|
|
1072 |
are possible.
|
|
|
1073 |
\begin{lemma}\label{rsimpIdem}
|
|
618
|
1074 |
$\rsimp{r} = \rsimp{(\rsimp{r})}$
|
|
614
|
1075 |
\end{lemma}
|
|
|
1076 |
|
|
|
1077 |
\begin{proof}
|
|
|
1078 |
By \ref{test} and \ref{good1}.
|
|
|
1079 |
\end{proof}
|
|
|
1080 |
\noindent
|
|
|
1081 |
This property means we do not have to repeatedly
|
|
|
1082 |
apply simplification in each step, which justifies
|
|
|
1083 |
our definition of $\blexersimp$.
|
|
|
1084 |
|
|
|
1085 |
|
|
618
|
1086 |
On the other hand, we can repeat the same $\rsimp{}$ applications
|
|
614
|
1087 |
on regular expressions as many times as we want, if we have at least
|
|
|
1088 |
one simplification applied to it, and apply it wherever we would like to:
|
|
|
1089 |
\begin{corollary}\label{headOneMoreSimp}
|
|
|
1090 |
The following properties hold, directly from \ref{rsimpIdem}:
|
|
|
1091 |
|
|
|
1092 |
\begin{itemize}
|
|
|
1093 |
\item
|
|
|
1094 |
$\map \; \rsimp{(r :: rs)} = \map \; \rsimp{} \; (\rsimp{r} :: rs)$
|
|
|
1095 |
\item
|
|
|
1096 |
$\rsimp{(\RALTS{rs})} = \rsimp{(\RALTS{\map \; \rsimp{} \; rs})}$
|
|
|
1097 |
\end{itemize}
|
|
|
1098 |
\end{corollary}
|
|
|
1099 |
\noindent
|
|
618
|
1100 |
This will be useful in the later closed form proof's rewriting steps.
|
|
|
1101 |
Similarly, we state the following useful facts below:
|
|
614
|
1102 |
\begin{lemma}
|
|
|
1103 |
The following equalities hold if $r = \rsimp{r'}$ for some $r'$:
|
|
|
1104 |
\begin{itemize}
|
|
|
1105 |
\item
|
|
|
1106 |
If $r = \sum rs$ then $\rsimpalts \; rs = \sum rs$.
|
|
|
1107 |
\item
|
|
|
1108 |
If $r = \sum rs$ then $\rdistinct{rs}{\varnothing} = rs$.
|
|
|
1109 |
\item
|
|
|
1110 |
$\rsimpalts \; (\rdistinct{\rflts \; [r]}{\varnothing}) = r$.
|
|
|
1111 |
\end{itemize}
|
|
|
1112 |
\end{lemma}
|
|
|
1113 |
\begin{proof}
|
|
|
1114 |
By application of lemmas \ref{rsimpIdem} and \ref{good1}.
|
|
|
1115 |
\end{proof}
|
|
|
1116 |
|
|
|
1117 |
\noindent
|
|
|
1118 |
With the idempotency of $\rsimp{}$ and its corollaries,
|
|
|
1119 |
we can start proving some key equalities leading to the
|
|
|
1120 |
closed forms.
|
|
|
1121 |
Now presented are a few equivalent terms under $\rsimp{}$.
|
|
618
|
1122 |
To make the notation more concise
|
|
|
1123 |
We use $r_1 \sequal r_2 $ to denote that $\rsimp{r_1} = \rsimp{r_2}$:
|
|
|
1124 |
\begin{center}
|
|
|
1125 |
\begin{tabular}{lcl}
|
|
|
1126 |
$a \sequal b$ & $ \dn$ & $ \textit{rsimp} \; a = \textit{rsimp} \; b$
|
|
|
1127 |
\end{tabular}
|
|
|
1128 |
\end{center}
|
|
|
1129 |
\noindent
|
|
|
1130 |
%\vspace{0em}
|
|
614
|
1131 |
\begin{lemma}
|
|
618
|
1132 |
The following equivalence hold:
|
|
614
|
1133 |
\begin{itemize}
|
|
|
1134 |
\item
|
|
|
1135 |
$\rsimpalts \; (\RZERO :: rs) \sequal \rsimpalts\; rs$
|
|
|
1136 |
\item
|
|
|
1137 |
$\rsimpalts \; rs \sequal \rsimpalts (\map \; \rsimp{} \; rs)$
|
|
|
1138 |
\item
|
|
|
1139 |
$\RALTS{\RALTS{rs}} \sequal \RALTS{rs}$
|
|
|
1140 |
\item
|
|
|
1141 |
$\sum ((\sum rs_a) :: rs_b) \sequal \sum rs_a @ rs_b$
|
|
|
1142 |
\item
|
|
|
1143 |
$\RALTS{rs} = \RALTS{\map \; \rsimp{} \; rs}$
|
|
|
1144 |
\end{itemize}
|
|
|
1145 |
\end{lemma}
|
|
|
1146 |
\begin{proof}
|
|
|
1147 |
By induction on the lists involved.
|
|
|
1148 |
\end{proof}
|
|
|
1149 |
\noindent
|
|
|
1150 |
The above allows us to prove
|
|
|
1151 |
two similar equalities (which are a bit more involved).
|
|
618
|
1152 |
It says that we could flatten the elements
|
|
614
|
1153 |
before simplification and still get the same result.
|
|
|
1154 |
\begin{lemma}\label{simpFlatten3}
|
|
|
1155 |
One can flatten the inside $\sum$ of a $\sum$ if it is being
|
|
|
1156 |
simplified. Concretely,
|
|
|
1157 |
\begin{itemize}
|
|
|
1158 |
\item
|
|
|
1159 |
If for all $r \in rs, rs', rs''$, we have $\good \; r $
|
|
|
1160 |
or $r = \RZERO$, then $\sum (rs' @ rs @ rs'') \sequal
|
|
|
1161 |
\sum (rs' @ [\sum rs] @ rs'')$ holds. As a corollary,
|
|
|
1162 |
\item
|
|
|
1163 |
$\sum (rs' @ [\sum rs] @ rs'') \sequal \sum (rs' @ rs @ rs'')$
|
|
|
1164 |
\end{itemize}
|
|
|
1165 |
\end{lemma}
|
|
|
1166 |
\begin{proof}
|
|
|
1167 |
By rewriting steps involving the use of \ref{test} and \ref{rdistinctConcatGeneral}.
|
|
|
1168 |
The second sub-lemma is a corollary of the previous.
|
|
|
1169 |
\end{proof}
|
|
|
1170 |
%Rewriting steps not put in--too long and complicated-------------------------------
|
|
|
1171 |
\begin{comment}
|
|
|
1172 |
\begin{center}
|
|
|
1173 |
$\rsimp{\sum (rs' @ rs @ rs'')} \stackrel{def of bsimp}{=}$ \\
|
|
|
1174 |
$\rsimpalts \; (\rdistinct{\rflts \; ((\map \; \rsimp{}\; rs') @ (\map \; \rsimp{} \; rs ) @ (\map \; \rsimp{} \; rs''))}{\varnothing})$ \\
|
|
|
1175 |
$\stackrel{by \ref{test}}{=}
|
|
|
1176 |
\rsimpalts \; (\rdistinct{(\rflts \; rs' @ \rflts \; rs @ \rflts \; rs'')}{
|
|
|
1177 |
\varnothing})$\\
|
|
|
1178 |
$\stackrel{by \ref{rdistinctConcatGeneral}}{=}
|
|
|
1179 |
\rsimpalts \; (\rdistinct{\rflts \; rs'}{\varnothing} @ \rdistinct{(
|
|
|
1180 |
\rflts\; rs @ \rflts \; rs'')}{\rflts \; rs'})$\\
|
|
|
1181 |
|
|
|
1182 |
\end{center}
|
|
|
1183 |
\end{comment}
|
|
|
1184 |
%Rewriting steps not put in--too long and complicated-------------------------------
|
|
|
1185 |
\noindent
|
|
|
1186 |
|
|
|
1187 |
|
|
618
|
1188 |
We need more equalities like the above to enable a closed form lemma,
|
|
613
|
1189 |
for which we need to introduce a few rewrite relations
|
|
|
1190 |
to help
|
|
|
1191 |
us obtain them.
|
|
554
|
1192 |
|
|
610
|
1193 |
\subsection{The rewrite relation $\hrewrite$ , $\scfrewrites$ , $\frewrite$ and $\grewrite$}
|
|
613
|
1194 |
Inspired by the success we had in the correctness proof
|
|
|
1195 |
in \ref{Bitcoded2},
|
|
|
1196 |
we follow suit here, defining atomic simplification
|
|
|
1197 |
steps as ``small-step'' rewriting steps. This allows capturing
|
|
555
|
1198 |
similarities between terms that would be otherwise
|
|
|
1199 |
hard to express.
|
|
|
1200 |
|
|
557
|
1201 |
We use $\hrewrite$ for one-step atomic rewrite of
|
|
|
1202 |
regular expression simplification,
|
|
555
|
1203 |
$\frewrite$ for rewrite of list of regular expressions that
|
|
|
1204 |
include all operations carried out in $\rflts$, and $\grewrite$ for
|
|
613
|
1205 |
rewriting a list of regular expressions possible in both $\rflts$ and $\textit{rdistinct}$.
|
|
555
|
1206 |
Their reflexive transitive closures are used to denote zero or many steps,
|
|
|
1207 |
as was the case in the previous chapter.
|
|
613
|
1208 |
As we have already
|
|
|
1209 |
done something similar, the presentation about
|
|
|
1210 |
these rewriting rules will be more concise than that in \ref{Bitcoded2}.
|
|
554
|
1211 |
To differentiate between the rewriting steps for annotated regular expressions
|
|
|
1212 |
and $\rrexp$s, we add characters $h$ and $g$ below the squig arrow symbol
|
|
|
1213 |
to mean atomic simplification transitions
|
|
|
1214 |
of $\rrexp$s and $\rrexp$ lists, respectively.
|
|
|
1215 |
|
|
555
|
1216 |
|
|
|
1217 |
|
|
|
1218 |
|
|
613
|
1219 |
\begin{figure}[H]
|
|
554
|
1220 |
\begin{center}
|
|
593
|
1221 |
\begin{mathpar}
|
|
|
1222 |
\inferrule[RSEQ0L]{}{\RZERO \cdot r_2 \hrewrite \RZERO\\}
|
|
555
|
1223 |
|
|
593
|
1224 |
\inferrule[RSEQ0R]{}{r_1 \cdot \RZERO \hrewrite \RZERO\\}
|
|
555
|
1225 |
|
|
593
|
1226 |
\inferrule[RSEQ1]{}{(\RONE \cdot r) \hrewrite r\\}\\
|
|
555
|
1227 |
|
|
593
|
1228 |
\inferrule[RSEQL]{ r_1 \hrewrite r_2}{r_1 \cdot r_3 \hrewrite r_2 \cdot r_3\\}
|
|
|
1229 |
|
|
|
1230 |
\inferrule[RSEQR]{ r_3 \hrewrite r_4}{r_1 \cdot r_3 \hrewrite r_1 \cdot r_4\\}\\
|
|
555
|
1231 |
|
|
593
|
1232 |
\inferrule[RALTSChild]{r \hrewrite r'}{\sum (rs_1 @ [r] @ rs_2) \hrewrite \sum (rs_1 @ [r'] @ rs_2)\\}
|
|
555
|
1233 |
|
|
593
|
1234 |
\inferrule[RALTS0]{}{\sum (rs_a @ [\RZERO] @ rs_b) \hrewrite \sum (rs_a @ rs_b)}
|
|
555
|
1235 |
|
|
593
|
1236 |
\inferrule[RALTSNested]{}{\sum (rs_a @ [\sum rs_1] @ rs_b) \hrewrite \sum (rs_a @ rs_1 @ rs_b)}
|
|
555
|
1237 |
|
|
593
|
1238 |
\inferrule[RALTSNil]{}{ \sum [] \hrewrite \RZERO\\}
|
|
555
|
1239 |
|
|
593
|
1240 |
\inferrule[RALTSSingle]{}{ \sum [r] \hrewrite r\\}
|
|
555
|
1241 |
|
|
593
|
1242 |
\inferrule[RALTSDelete]{\\ r_1 = r_2}{\sum rs_a @ [r_1] @ rs_b @ [r_2] @ rsc \hrewrite \sum rs_a @ [r_1] @ rs_b @ rs_c}
|
|
555
|
1243 |
|
|
593
|
1244 |
\end{mathpar}
|
|
555
|
1245 |
\end{center}
|
|
613
|
1246 |
\caption{List of one-step rewrite rules for r-regular expressions ($\hrewrite$)}\label{hRewrite}
|
|
|
1247 |
\end{figure}
|
|
554
|
1248 |
|
|
557
|
1249 |
|
|
613
|
1250 |
Like $\rightsquigarrow_s$, it is
|
|
|
1251 |
convenient to define rewrite rules for a list of regular expressions,
|
|
593
|
1252 |
where each element can rewrite in many steps to the other (scf stands for
|
|
|
1253 |
li\emph{s}t \emph{c}losed \emph{f}orm). This relation is similar to the
|
|
|
1254 |
$\stackrel{s*}{\rightsquigarrow}$ for annotated regular expressions.
|
|
557
|
1255 |
|
|
613
|
1256 |
\begin{figure}[H]
|
|
557
|
1257 |
\begin{center}
|
|
593
|
1258 |
\begin{mathpar}
|
|
|
1259 |
\inferrule{}{[] \scfrewrites [] }
|
|
613
|
1260 |
|
|
593
|
1261 |
\inferrule{r \hrewrites r' \\ rs \scfrewrites rs'}{r :: rs \scfrewrites r' :: rs'}
|
|
|
1262 |
\end{mathpar}
|
|
557
|
1263 |
\end{center}
|
|
613
|
1264 |
\caption{List of one-step rewrite rules for a list of r-regular expressions}\label{scfRewrite}
|
|
|
1265 |
\end{figure}
|
|
555
|
1266 |
%frewrite
|
|
593
|
1267 |
List of one-step rewrite rules for flattening
|
|
|
1268 |
a list of regular expressions($\frewrite$):
|
|
613
|
1269 |
\begin{figure}[H]
|
|
555
|
1270 |
\begin{center}
|
|
593
|
1271 |
\begin{mathpar}
|
|
|
1272 |
\inferrule{}{\RZERO :: rs \frewrite rs \\}
|
|
555
|
1273 |
|
|
593
|
1274 |
\inferrule{}{(\sum rs) :: rs_a \frewrite rs @ rs_a \\}
|
|
555
|
1275 |
|
|
593
|
1276 |
\inferrule{rs_1 \frewrite rs_2}{r :: rs_1 \frewrite r :: rs_2}
|
|
|
1277 |
\end{mathpar}
|
|
555
|
1278 |
\end{center}
|
|
613
|
1279 |
\caption{List of one-step rewrite rules characterising the $\rflts$ operation on a list}\label{fRewrites}
|
|
|
1280 |
\end{figure}
|
|
555
|
1281 |
|
|
593
|
1282 |
Lists of one-step rewrite rules for flattening and de-duplicating
|
|
|
1283 |
a list of regular expressions ($\grewrite$):
|
|
613
|
1284 |
\begin{figure}[H]
|
|
555
|
1285 |
\begin{center}
|
|
593
|
1286 |
\begin{mathpar}
|
|
|
1287 |
\inferrule{}{\RZERO :: rs \grewrite rs \\}
|
|
532
|
1288 |
|
|
593
|
1289 |
\inferrule{}{(\sum rs) :: rs_a \grewrite rs @ rs_a \\}
|
|
555
|
1290 |
|
|
593
|
1291 |
\inferrule{rs_1 \grewrite rs_2}{r :: rs_1 \grewrite r :: rs_2}
|
|
555
|
1292 |
|
|
593
|
1293 |
\inferrule[dB]{}{rs_a @ [a] @ rs_b @[a] @ rs_c \grewrite rs_a @ [a] @ rsb @ rsc}
|
|
|
1294 |
\end{mathpar}
|
|
555
|
1295 |
\end{center}
|
|
613
|
1296 |
\caption{List of one-step rewrite rules characterising the $\rflts$ and $\textit{rdistinct}$
|
|
|
1297 |
operations}\label{gRewrite}
|
|
|
1298 |
\end{figure}
|
|
555
|
1299 |
\noindent
|
|
618
|
1300 |
We define
|
|
613
|
1301 |
two separate list rewriting relations $\frewrite$ and $\grewrite$.
|
|
611
|
1302 |
The rewriting steps that take place during
|
|
|
1303 |
flattening is characterised by $\frewrite$.
|
|
618
|
1304 |
The rewrite relation $\grewrite$ characterises both flattening and de-duplicating.
|
|
557
|
1305 |
Sometimes $\grewrites$ is slightly too powerful
|
|
613
|
1306 |
so we would rather use $\frewrites$ to prove
|
|
|
1307 |
%because we only
|
|
|
1308 |
equalities related to $\rflts$.
|
|
|
1309 |
%certain equivalence under the rewriting steps of $\frewrites$.
|
|
556
|
1310 |
For example, when proving the closed-form for the alternative regular expression,
|
|
613
|
1311 |
one of the equalities needed is:
|
|
|
1312 |
\begin{center}
|
|
557
|
1313 |
$\sum (\rDistinct \;\; (\map \; (\_ \backslash x) \; (\rflts \; rs)) \;\; \varnothing) \sequal
|
|
593
|
1314 |
\sum (\rDistinct \;\; (\rflts \; (\map \; (\_ \backslash x) \; rs)) \;\; \varnothing)
|
|
|
1315 |
$
|
|
613
|
1316 |
\end{center}
|
|
556
|
1317 |
\noindent
|
|
|
1318 |
Proving this is by first showing
|
|
557
|
1319 |
\begin{lemma}\label{earlyLaterDerFrewrites}
|
|
556
|
1320 |
$\map \; (\_ \backslash x) \; (\rflts \; rs) \frewrites
|
|
557
|
1321 |
\rflts \; (\map \; (\_ \backslash x) \; rs)$
|
|
556
|
1322 |
\end{lemma}
|
|
|
1323 |
\noindent
|
|
613
|
1324 |
and then the equivalence between two terms
|
|
618
|
1325 |
that can reduce in many steps to each other:
|
|
556
|
1326 |
\begin{lemma}\label{frewritesSimpeq}
|
|
|
1327 |
If $rs_1 \frewrites rs_2 $, then $\sum (\rDistinct \; rs_1 \; \varnothing) \sequal
|
|
557
|
1328 |
\sum (\rDistinct \; rs_2 \; \varnothing)$.
|
|
556
|
1329 |
\end{lemma}
|
|
557
|
1330 |
\noindent
|
|
618
|
1331 |
These two lemmas can both be proven using a straightforward induction (and
|
|
|
1332 |
the proofs for them are therefore omitted).
|
|
613
|
1333 |
|
|
618
|
1334 |
Now the above equalities can be derived like a breeze:
|
|
613
|
1335 |
\begin{corollary}
|
|
|
1336 |
$\sum (\rDistinct \;\; (\map \; (\_ \backslash x) \; (\rflts \; rs)) \;\; \varnothing) \sequal
|
|
|
1337 |
\sum (\rDistinct \;\; (\rflts \; (\map \; (\_ \backslash x) \; rs)) \;\; \varnothing)
|
|
|
1338 |
$
|
|
|
1339 |
\end{corollary}
|
|
618
|
1340 |
\begin{proof}
|
|
|
1341 |
By lemmas \ref{earlyLaterDerFrewrites} and \ref{frewritesSimpeq}.
|
|
|
1342 |
\end{proof}
|
|
557
|
1343 |
But this trick will not work for $\grewrites$.
|
|
|
1344 |
For example, a rewriting step in proving
|
|
|
1345 |
closed forms is:
|
|
|
1346 |
\begin{center}
|
|
593
|
1347 |
$\rsimp{(\rsimpalts \; (\map \; (\_ \backslash x) \; (\rdistinct{(\rflts \; (\map \; (\rsimp{} \; \circ \; (\lambda r. \rderssimp{r}{xs}))))}{\varnothing})))}$\\
|
|
|
1348 |
$=$ \\
|
|
|
1349 |
$\rsimp{(\rsimpalts \; (\rdistinct{(\map \; (\_ \backslash x) \; (\rflts \; (\map \; (\rsimp{} \; \circ \; (\lambda r. \rderssimp{r}{xs})))) ) }{\varnothing}))} $
|
|
|
1350 |
\noindent
|
|
557
|
1351 |
\end{center}
|
|
618
|
1352 |
For this, one would hope to have a rewriting relation between the two lists involved,
|
|
557
|
1353 |
similar to \ref{earlyLaterDerFrewrites}. However, it turns out that
|
|
556
|
1354 |
\begin{center}
|
|
593
|
1355 |
$\map \; (\_ \backslash x) \; (\rDistinct \; rs \; rset) \grewrites \rDistinct \; (\map \;
|
|
|
1356 |
(\_ \backslash x) \; rs) \; ( rset \backslash x)$
|
|
556
|
1357 |
\end{center}
|
|
|
1358 |
\noindent
|
|
557
|
1359 |
does $\mathbf{not}$ hold in general.
|
|
|
1360 |
For this rewriting step we will introduce some slightly more cumbersome
|
|
618
|
1361 |
proof technique later.
|
|
557
|
1362 |
The point is that $\frewrite$
|
|
613
|
1363 |
allows us to prove equivalence in a straightforward way that is
|
|
|
1364 |
not possible for $\grewrite$.
|
|
555
|
1365 |
|
|
556
|
1366 |
|
|
557
|
1367 |
\subsubsection{Terms That Can Be Rewritten Using $\hrewrites$, $\grewrites$, and $\frewrites$}
|
|
613
|
1368 |
In this part, we present lemmas stating
|
|
618
|
1369 |
pairs of r-regular expressions and r-regular expression lists
|
|
613
|
1370 |
where one could rewrite from one in many steps to the other.
|
|
|
1371 |
Most of the proofs to these lemmas are straightforward, using
|
|
618
|
1372 |
an induction on the corresponding rewriting relations.
|
|
613
|
1373 |
These proofs will therefore be omitted when this is the case.
|
|
618
|
1374 |
We present in the following lemma a few pairs of terms that are rewritable via
|
|
557
|
1375 |
$\grewrites$:
|
|
|
1376 |
\begin{lemma}\label{gstarRdistinctGeneral}
|
|
613
|
1377 |
\mbox{}
|
|
557
|
1378 |
\begin{itemize}
|
|
|
1379 |
\item
|
|
|
1380 |
$rs_1 @ rs \grewrites rs_1 @ (\rDistinct \; rs \; rs_1)$
|
|
|
1381 |
\item
|
|
|
1382 |
$rs \grewrites \rDistinct \; rs \; \varnothing$
|
|
|
1383 |
\item
|
|
|
1384 |
$rs_a @ (\rDistinct \; rs \; rs_a) \grewrites rs_a @ (\rDistinct \;
|
|
|
1385 |
rs \; (\{\RZERO\} \cup rs_a))$
|
|
|
1386 |
\item
|
|
|
1387 |
$rs \;\; @ \;\; \rDistinct \; rs_a \; rset \grewrites rs @ \rDistinct \; rs_a \;
|
|
|
1388 |
(rest \cup rs)$
|
|
|
1389 |
|
|
|
1390 |
\end{itemize}
|
|
|
1391 |
\end{lemma}
|
|
|
1392 |
\noindent
|
|
|
1393 |
If a pair of terms $rs_1, rs_2$ are rewritable via $\grewrites$ to each other,
|
|
|
1394 |
then they are equivalent under $\rsimp{}$:
|
|
|
1395 |
\begin{lemma}\label{grewritesSimpalts}
|
|
618
|
1396 |
\mbox{}
|
|
557
|
1397 |
If $rs_1 \grewrites rs_2$, then
|
|
613
|
1398 |
we have the following equivalence:
|
|
557
|
1399 |
\begin{itemize}
|
|
|
1400 |
\item
|
|
|
1401 |
$\sum rs_1 \sequal \sum rs_2$
|
|
|
1402 |
\item
|
|
|
1403 |
$\rsimpalts \; rs_1 \sequal \rsimpalts \; rs_2$
|
|
|
1404 |
\end{itemize}
|
|
|
1405 |
\end{lemma}
|
|
|
1406 |
\noindent
|
|
|
1407 |
Here are a few connecting lemmas showing that
|
|
|
1408 |
if a list of regular expressions can be rewritten using $\grewrites$ or $\frewrites $ or
|
|
|
1409 |
$\scfrewrites$,
|
|
|
1410 |
then an alternative constructor taking the list can also be rewritten using $\hrewrites$:
|
|
|
1411 |
\begin{lemma}
|
|
|
1412 |
\begin{itemize}
|
|
|
1413 |
\item
|
|
|
1414 |
If $rs \grewrites rs'$ then $\sum rs \hrewrites \sum rs'$.
|
|
|
1415 |
\item
|
|
|
1416 |
If $rs \grewrites rs'$ then $\sum rs \hrewrites \rsimpalts \; rs'$
|
|
|
1417 |
\item
|
|
|
1418 |
If $rs_1 \scfrewrites rs_2$ then $\sum (rs @ rs_1) \hrewrites \sum (rs @ rs_2)$
|
|
|
1419 |
\item
|
|
|
1420 |
If $rs_1 \scfrewrites rs_2$ then $\sum rs_1 \hrewrites \sum rs_2$
|
|
|
1421 |
|
|
|
1422 |
\end{itemize}
|
|
|
1423 |
\end{lemma}
|
|
|
1424 |
\noindent
|
|
618
|
1425 |
Now comes the core of the proof,
|
|
557
|
1426 |
which says that once two lists are rewritable to each other,
|
|
|
1427 |
then they are equivalent under $\rsimp{}$:
|
|
|
1428 |
\begin{lemma}
|
|
|
1429 |
If $r_1 \hrewrites r_2$ then $r_1 \sequal r_2$.
|
|
|
1430 |
\end{lemma}
|
|
|
1431 |
|
|
|
1432 |
\noindent
|
|
618
|
1433 |
Similar to what we did in \ref{Bitcoded2},
|
|
|
1434 |
we prove that if one can rewrite from one r-regular expression ($r$)
|
|
|
1435 |
to the other ($r'$), after taking derivatives one could still rewrite
|
|
|
1436 |
the first ($r\backslash c$) to the other ($r'\backslash c$).
|
|
557
|
1437 |
\begin{lemma}\label{interleave}
|
|
|
1438 |
If $r \hrewrites r' $ then $\rder{c}{r} \hrewrites \rder{c}{r'}$
|
|
|
1439 |
\end{lemma}
|
|
|
1440 |
\noindent
|
|
618
|
1441 |
This allows us proving more $\mathbf{rsimp}$-equivalent terms, involving $\backslash_r$.
|
|
557
|
1442 |
\begin{lemma}\label{insideSimpRemoval}
|
|
618
|
1443 |
$\rsimp{(\rder{c}{(\rsimp{r})})} = \rsimp{(\rder{c}{r})} $
|
|
557
|
1444 |
\end{lemma}
|
|
|
1445 |
\noindent
|
|
|
1446 |
\begin{proof}
|
|
|
1447 |
By \ref{interleave} and \ref{rsimpIdem}.
|
|
|
1448 |
\end{proof}
|
|
|
1449 |
\noindent
|
|
|
1450 |
And this unlocks more equivalent terms:
|
|
|
1451 |
\begin{lemma}\label{Simpders}
|
|
|
1452 |
As corollaries of \ref{insideSimpRemoval}, we have
|
|
|
1453 |
\begin{itemize}
|
|
|
1454 |
\item
|
|
620
|
1455 |
If $s \neq []$ then $\rderssimp{r}{s} = \rsimp{( r \backslash_{rs} s)}$.
|
|
557
|
1456 |
\item
|
|
|
1457 |
$\rsimpalts \; (\map \; (\_ \backslash_r x) \;
|
|
593
|
1458 |
(\rdistinct{rs}{\varnothing})) \sequal
|
|
|
1459 |
\rsimpalts \; (\rDistinct \;
|
|
|
1460 |
(\map \; (\_ \backslash_r x) rs) \;\varnothing )$
|
|
|
1461 |
\end{itemize}
|
|
|
1462 |
\end{lemma}
|
|
611
|
1463 |
\begin{proof}
|
|
|
1464 |
Part 1 is by lemma \ref{insideSimpRemoval},
|
|
613
|
1465 |
part 2 is by lemma \ref{insideSimpRemoval} .%and \ref{distinctDer}.
|
|
611
|
1466 |
\end{proof}
|
|
557
|
1467 |
\noindent
|
|
613
|
1468 |
|
|
|
1469 |
\subsection{Closed Forms for $\sum rs$, $r_1\cdot r_2$ and $r^*$}
|
|
618
|
1470 |
Lemma \ref{Simpders} leads to our first closed form,
|
|
|
1471 |
which is for the alternative regular expression:
|
|
|
1472 |
\begin{theorem}\label{altsClosedForm}
|
|
|
1473 |
\mbox{}
|
|
593
|
1474 |
\begin{center}
|
|
|
1475 |
$\rderssimp{(\sum rs)}{s} \sequal
|
|
|
1476 |
\sum \; (\map \; (\rderssimp{\_}{s}) \; rs)$
|
|
|
1477 |
\end{center}
|
|
618
|
1478 |
\end{theorem}
|
|
556
|
1479 |
\noindent
|
|
557
|
1480 |
\begin{proof}
|
|
|
1481 |
By a reverse induction on the string $s$.
|
|
|
1482 |
One rewriting step, as we mentioned earlier,
|
|
|
1483 |
involves
|
|
|
1484 |
\begin{center}
|
|
|
1485 |
$\rsimpalts \; (\map \; (\_ \backslash x) \;
|
|
|
1486 |
(\rdistinct{(\rflts \; (\map \; (\rsimp{} \; \circ \;
|
|
|
1487 |
(\lambda r. \rderssimp{r}{xs}))))}{\varnothing}))
|
|
|
1488 |
\sequal
|
|
|
1489 |
\rsimpalts \; (\rdistinct{(\map \; (\_ \backslash x) \;
|
|
593
|
1490 |
(\rflts \; (\map \; (\rsimp{} \; \circ \;
|
|
557
|
1491 |
(\lambda r. \rderssimp{r}{xs})))) ) }{\varnothing}) $.
|
|
|
1492 |
\end{center}
|
|
|
1493 |
This can be proven by a combination of
|
|
|
1494 |
\ref{grewritesSimpalts}, \ref{gstarRdistinctGeneral}, \ref{rderRsimpAltsCommute}, and
|
|
|
1495 |
\ref{insideSimpRemoval}.
|
|
|
1496 |
\end{proof}
|
|
|
1497 |
\noindent
|
|
|
1498 |
This closed form has a variant which can be more convenient in later proofs:
|
|
618
|
1499 |
\begin{corollary}\label{altsClosedForm1}
|
|
557
|
1500 |
If $s \neq []$ then
|
|
|
1501 |
$\rderssimp \; (\sum \; rs) \; s =
|
|
|
1502 |
\rsimp{(\sum \; (\map \; \rderssimp{\_}{s} \; rs))}$.
|
|
|
1503 |
\end{corollary}
|
|
|
1504 |
\noindent
|
|
|
1505 |
The harder closed forms are the sequence and star ones.
|
|
613
|
1506 |
Before we obtain them, some preliminary definitions
|
|
557
|
1507 |
are needed to make proof statements concise.
|
|
556
|
1508 |
|
|
609
|
1509 |
|
|
|
1510 |
\subsubsection{Closed Form for Sequence Regular Expressions}
|
|
618
|
1511 |
For the sequence regular expression,
|
|
|
1512 |
let's first look at a series of derivative steps on it
|
|
|
1513 |
(assuming that each time when a derivative is taken,
|
|
|
1514 |
the head of the sequence is always nullable):
|
|
557
|
1515 |
\begin{center}
|
|
618
|
1516 |
\begin{tabular}{llll}
|
|
|
1517 |
$r_1 \cdot r_2$ &
|
|
|
1518 |
$\longrightarrow_{\backslash c}$ &
|
|
|
1519 |
$r_1\backslash c \cdot r_2 + r_2 \backslash c$ &
|
|
|
1520 |
$ \longrightarrow_{\backslash c'} $ \\
|
|
|
1521 |
\\
|
|
|
1522 |
$(r_1 \backslash cc' \cdot r_2 + r_2 \backslash c') + r_2 \backslash cc'$ &
|
|
|
1523 |
$\longrightarrow_{\backslash c''} $ &
|
|
|
1524 |
$((r_1 \backslash cc'c'' \cdot r_2 + r_2 \backslash c'') + r_2 \backslash c'c'')
|
|
|
1525 |
+ r_2 \backslash cc'c''$ &
|
|
|
1526 |
$ \longrightarrow_{\backslash c''} \quad \ldots$\\
|
|
|
1527 |
\end{tabular}
|
|
557
|
1528 |
\end{center}
|
|
558
|
1529 |
Roughly speaking $r_1 \cdot r_2 \backslash s$ can be expresssed as
|
|
|
1530 |
a giant alternative taking a list of terms
|
|
|
1531 |
$[r_1 \backslash_r s \cdot r_2, r_2 \backslash_r s'', r_2 \backslash_r s_1'', \ldots]$,
|
|
|
1532 |
where the head of the list is always the term
|
|
|
1533 |
representing a match involving only $r_1$, and the tail of the list consisting of
|
|
|
1534 |
terms of the shape $r_2 \backslash_r s''$, $s''$ being a suffix of $s$.
|
|
618
|
1535 |
This intuition is also echoed by Murugesan and Sundaram \cite{Murugesan2014},
|
|
|
1536 |
where they gave
|
|
557
|
1537 |
a pencil-and-paper derivation of $(r_1 \cdot r_2)\backslash s$:
|
|
532
|
1538 |
\begin{center}
|
|
618
|
1539 |
\begin{tabular}{lc}
|
|
|
1540 |
$L \; [ (r_1 \cdot r_2) \backslash_r (c_1 :: c_2 :: \ldots c_n) ]$ & $ =$\\
|
|
|
1541 |
\\
|
|
|
1542 |
\rule{0pt}{3ex} $L \; [ ((r_1 \backslash_r c_1) \cdot r_2 +
|
|
|
1543 |
(\delta\; (\nullable \; r_1) \; (r_2 \backslash_r c_1) )) \backslash_r
|
|
|
1544 |
(c_2 :: \ldots c_n) ]$ &
|
|
|
1545 |
$=$\\
|
|
|
1546 |
\\
|
|
|
1547 |
\rule{0pt}{3ex} $L \; [ ((r_1 \backslash_r c_1c_2 \cdot r_2 +
|
|
|
1548 |
(\delta \; (\nullable \; r_1) \; (r_2 \backslash_r c_1c_2)))
|
|
|
1549 |
$ & \\
|
|
|
1550 |
\\
|
|
|
1551 |
$\quad + (\delta \ (\nullable \; r_1 \backslash_r c)\; (r_2 \backslash_r c_2) ))
|
|
|
1552 |
\backslash_r (c_3 \ldots c_n) ]$ & $\ldots$ \\
|
|
558
|
1553 |
\end{tabular}
|
|
557
|
1554 |
\end{center}
|
|
|
1555 |
\noindent
|
|
618
|
1556 |
The $\delta$ function
|
|
|
1557 |
returns $r$ when the boolean condition
|
|
|
1558 |
$b$ evaluates to true and
|
|
|
1559 |
$\ZERO$ otherwise:
|
|
|
1560 |
\begin{center}
|
|
|
1561 |
\begin{tabular}{lcl}
|
|
|
1562 |
$\delta \; b\; r$ & $\dn$ & $r \quad \textit{if} \; b \; is \;\textit{true}$\\
|
|
|
1563 |
& $\dn$ & $\ZERO \quad otherwise$
|
|
|
1564 |
\end{tabular}
|
|
|
1565 |
\end{center}
|
|
|
1566 |
\noindent
|
|
|
1567 |
Note that the term
|
|
|
1568 |
\begin{center}
|
|
|
1569 |
\begin{tabular}{lc}
|
|
|
1570 |
\rule{0pt}{3ex} $((r_1 \backslash_r c_1c_2 \cdot r_2 +
|
|
|
1571 |
(\delta \; (\nullable \; r_1) \; (r_2 \backslash_r c_1c_2)))
|
|
|
1572 |
$ & \\
|
|
|
1573 |
\\
|
|
|
1574 |
$\quad + (\delta \ (\nullable \; r_1 \backslash_r c)\; (r_2 \backslash_r c_2) ))
|
|
|
1575 |
\backslash_r (c_3 \ldots c_n)$ &\\
|
|
|
1576 |
\end{tabular}
|
|
|
1577 |
\end{center}
|
|
|
1578 |
\noindent
|
|
558
|
1579 |
does not faithfully
|
|
|
1580 |
represent what the intermediate derivatives would actually look like
|
|
|
1581 |
when one or more intermediate results $r_1 \backslash s' \cdot r_2$ are not
|
|
|
1582 |
nullable in the head of the sequence.
|
|
|
1583 |
For example, when $r_1$ and $r_1 \backslash_r c_1$ are not nullable,
|
|
|
1584 |
the regular expression would not look like
|
|
|
1585 |
\[
|
|
618
|
1586 |
r_1 \backslash_r c_1c_2
|
|
558
|
1587 |
\]
|
|
618
|
1588 |
instead of
|
|
|
1589 |
\[
|
|
|
1590 |
(r_1 \backslash_r c_1c_2 + \ZERO ) + \ZERO.
|
|
|
1591 |
\]
|
|
|
1592 |
The redundant $\ZERO$s will not be created in the
|
|
558
|
1593 |
first place.
|
|
618
|
1594 |
In a closed-form one needs to take into account this (because
|
|
|
1595 |
closed forms require exact equality rather than language equivalence)
|
|
|
1596 |
and only generate the
|
|
|
1597 |
$r_2 \backslash_r s''$ terms satisfying the property
|
|
|
1598 |
\begin{center}
|
|
|
1599 |
$\exists s'. such \; that \; s'@s'' = s \;\; \land \;\;
|
|
|
1600 |
r_1 \backslash s' \; is \; nullable$.
|
|
|
1601 |
\end{center}
|
|
|
1602 |
Given the arguments $s$ and $r_1$, we denote the list of strings
|
|
|
1603 |
$s''$ satisfying the above property as $\vsuf{s}{r_1}$.
|
|
|
1604 |
The function $\vsuf{\_}{\_}$ is defined recursively on the structure of the string\footnote{
|
|
|
1605 |
Perhaps a better name of it would be ``NullablePrefixSuffix''
|
|
|
1606 |
to differentiate with the list of \emph{all} prefixes of $s$, but
|
|
|
1607 |
that is a bit too long for a function name and we are yet to find
|
|
|
1608 |
a more concise and easy-to-understand name.}
|
|
558
|
1609 |
\begin{center}
|
|
593
|
1610 |
\begin{tabular}{lcl}
|
|
|
1611 |
$\vsuf{[]}{\_} $ & $=$ & $[]$\\
|
|
618
|
1612 |
$\vsuf{c::cs}{r_1}$ & $ =$ & $ \textit{if} \; (\rnullable{r_1}) \; \textit{then} \; (\vsuf{cs}{(\rder{c}{r_1})}) @ [c :: cs]$\\
|
|
593
|
1613 |
&& $\textit{else} \; (\vsuf{cs}{(\rder{c}{r_1}) }) $
|
|
|
1614 |
\end{tabular}
|
|
558
|
1615 |
\end{center}
|
|
|
1616 |
\noindent
|
|
618
|
1617 |
The list starts with shorter suffixes
|
|
|
1618 |
and ends with longer ones (in other words, the string elements $s''$
|
|
|
1619 |
in the list $\vsuf{s}{r_1}$ are sorted
|
|
|
1620 |
in the same order as that of the terms $r_2\backslash s''$
|
|
|
1621 |
appearing in $(r_1\cdot r_2)\backslash s$).
|
|
558
|
1622 |
In essence, $\vsuf{\_}{\_}$ is doing a
|
|
|
1623 |
"virtual derivative" of $r_1 \cdot r_2$, but instead of producing
|
|
|
1624 |
the entire result $(r_1 \cdot r_2) \backslash s$,
|
|
618
|
1625 |
it only stores strings,
|
|
|
1626 |
with each string $s''$ representing a term such that $r_2 \backslash s''$
|
|
|
1627 |
is occurring in $(r_1\cdot r_2)\backslash s$.
|
|
558
|
1628 |
|
|
618
|
1629 |
With $\textit{Suffix}$ we are ready to express the
|
|
|
1630 |
sequence regular expression's closed form,
|
|
|
1631 |
but before doing so
|
|
|
1632 |
more devices are needed.
|
|
|
1633 |
The first thing is the flattening function $\sflat{\_}$,
|
|
|
1634 |
which takes an alternative regular expression and produces a flattened version
|
|
|
1635 |
of that alternative regular expression.
|
|
|
1636 |
It is needed to convert
|
|
557
|
1637 |
a left-associative nested sequence of alternatives into
|
|
|
1638 |
a flattened list:
|
|
558
|
1639 |
\[
|
|
618
|
1640 |
\sum(\ldots ((r_1 + r_2) + r_3) + \ldots)
|
|
|
1641 |
\stackrel{\sflat{\_}}{\rightarrow}
|
|
|
1642 |
\sum[r_1, r_2, r_3, \ldots]
|
|
558
|
1643 |
\]
|
|
|
1644 |
\noindent
|
|
618
|
1645 |
The definitions of $\sflat{\_}$ and helper functions
|
|
|
1646 |
$\sflataux{\_}$ and $\llparenthesis \_ \rrparenthesis''$ are given below.
|
|
593
|
1647 |
\begin{center}
|
|
618
|
1648 |
\begin{tabular}{lcl}
|
|
|
1649 |
$\sflataux{\sum r :: rs}$ & $\dn$ & $\sflataux{r} @ rs$\\
|
|
|
1650 |
$\sflataux{\sum []}$ & $ \dn $ & $ []$\\
|
|
|
1651 |
$\sflataux r$ & $\dn$ & $ [r]$
|
|
593
|
1652 |
\end{tabular}
|
|
532
|
1653 |
\end{center}
|
|
|
1654 |
|
|
593
|
1655 |
\begin{center}
|
|
618
|
1656 |
\begin{tabular}{lcl}
|
|
|
1657 |
$\sflat{(\sum r :: rs)}$ & $\dn$ & $\sum (\sflataux{r} @ rs)$\\
|
|
|
1658 |
$\sflat{\sum []}$ & $ \dn $ & $ \sum []$\\
|
|
|
1659 |
$\sflat r$ & $\dn$ & $ r$
|
|
|
1660 |
\end{tabular}
|
|
|
1661 |
\end{center}
|
|
|
1662 |
|
|
|
1663 |
\begin{center}
|
|
|
1664 |
\begin{tabular}{lcl}
|
|
|
1665 |
$\sflataux{[]}'$ & $ \dn $ & $ []$\\
|
|
|
1666 |
$\sflataux{ (r_1 + r_2) :: rs }'$ & $\dn$ & $r_1 :: r_2 :: rs$\\
|
|
|
1667 |
$\sflataux{r :: rs}$ & $\dn$ & $ r::rs$
|
|
593
|
1668 |
\end{tabular}
|
|
557
|
1669 |
\end{center}
|
|
558
|
1670 |
\noindent
|
|
576
|
1671 |
$\sflataux{\_}$ breaks up nested alternative regular expressions
|
|
557
|
1672 |
of the $(\ldots((r_1 + r_2) + r_3) + \ldots )$(left-associated) shape
|
|
558
|
1673 |
into a "balanced" list: $\AALTS{\_}{[r_1,\, r_2 ,\, r_3, \ldots]}$.
|
|
557
|
1674 |
It will return the singleton list $[r]$ otherwise.
|
|
|
1675 |
$\sflat{\_}$ works the same as $\sflataux{\_}$, except that it keeps
|
|
|
1676 |
the output type a regular expression, not a list.
|
|
558
|
1677 |
$\sflataux{\_}$ and $\sflat{\_}$ are only recursive on the
|
|
|
1678 |
first element of the list.
|
|
618
|
1679 |
$\sflataux{\_}'$ takes a list of regular expressions as input, and outputs
|
|
|
1680 |
a list of regular expressions.
|
|
|
1681 |
The use of $\sflataux{\_}$ and $\sflataux{\_}'$ is clear once we have
|
|
|
1682 |
$\textit{createdBySequence}$ defined:
|
|
|
1683 |
\begin{center}
|
|
|
1684 |
\begin{mathpar}
|
|
|
1685 |
\inferrule{\mbox{}}{\textit{createdBySequence}\; (r_1 \cdot r_2)}
|
|
558
|
1686 |
|
|
618
|
1687 |
\inferrule{\textit{createdBySequence} \; r_1}{\textit{createdBySequence} \;
|
|
|
1688 |
(r_1 + r_2)}
|
|
|
1689 |
\end{mathpar}
|
|
|
1690 |
\end{center}
|
|
|
1691 |
\noindent
|
|
|
1692 |
The predicate $\textit{createdBySequence}$ is used to describe the shape of
|
|
|
1693 |
the derivative regular expressions $(r_1\cdot r_2) \backslash s$:
|
|
|
1694 |
\begin{lemma}\label{recursivelyDerseq}
|
|
|
1695 |
It is always the case that
|
|
|
1696 |
\begin{center}
|
|
|
1697 |
$\textit{createdBySequence} \; ( (r_1\cdot r_2) \backslash_r s) $
|
|
|
1698 |
\end{center}
|
|
|
1699 |
holds.
|
|
|
1700 |
\end{lemma}
|
|
|
1701 |
\begin{proof}
|
|
|
1702 |
By a reverse induction on the string $s$, where the inductive cases are $[]$
|
|
|
1703 |
and $xs @ [x]$.
|
|
|
1704 |
\end{proof}
|
|
|
1705 |
\noindent
|
|
|
1706 |
If we have a regular expression $r$ whose shpae
|
|
|
1707 |
fits into those described by $\textit{createdBySequence}$,
|
|
|
1708 |
then we can convert between
|
|
|
1709 |
$r \backslash_r c$ and $(\sflataux{r}) \backslash_r c$ with
|
|
|
1710 |
$\sflataux{\_}'$:
|
|
|
1711 |
\begin{lemma}\label{sfauIdemDer}
|
|
|
1712 |
If $\textit{createdBySequence} \; r$, then
|
|
|
1713 |
\begin{center}
|
|
|
1714 |
$\sflataux{ r \backslash_r c} =
|
|
|
1715 |
\llparenthesis (\map \; (\_ \backslash_r c) \; (\sflataux{r}) ) \rrparenthesis''$
|
|
|
1716 |
\end{center}
|
|
|
1717 |
holds.
|
|
|
1718 |
\end{lemma}
|
|
|
1719 |
\begin{proof}
|
|
|
1720 |
By a simple induction on the inductive cases of $\textit{createdBySequence}.
|
|
|
1721 |
$
|
|
|
1722 |
\end{proof}
|
|
|
1723 |
|
|
|
1724 |
Now we are ready to express
|
|
|
1725 |
the shape of $r_1 \cdot r_2 \backslash s$
|
|
558
|
1726 |
\begin{lemma}\label{seqSfau0}
|
|
618
|
1727 |
$\sflataux{(r_1 \cdot r_2) \backslash_r s} = (r_1 \backslash_r s) \cdot r_2
|
|
558
|
1728 |
:: (\map \; (r_2 \backslash_r \_) \; (\textit{Suffix} \; s \; r1))$
|
|
|
1729 |
\end{lemma}
|
|
|
1730 |
\begin{proof}
|
|
618
|
1731 |
By a reverse induction on the string $s$, where the inductive cases
|
|
|
1732 |
are $[]$ and $xs @ [x]$.
|
|
|
1733 |
For the inductive case, we know that $\textit{createdBySequence} \; ((r_1 \cdot r_2)
|
|
|
1734 |
\backslash_r xs)$ holds from lemma \ref{recursivelyDerseq},
|
|
|
1735 |
which can be used to prove
|
|
558
|
1736 |
\[
|
|
|
1737 |
\map \; (r_2 \backslash_r \_) \; (\vsuf{[x]}{(r_1 \backslash_r xs)}) \;\; @ \;\;
|
|
|
1738 |
\map \; (\_ \backslash_r x) \; (\map \; (r_2 \backslash \_) \; (\vsuf{xs}{r_1}))
|
|
|
1739 |
\]
|
|
593
|
1740 |
=
|
|
558
|
1741 |
\[
|
|
|
1742 |
\map \; (r_2 \backslash_r \_) \; (\vsuf{xs @ [x]}{r_1})
|
|
|
1743 |
\]
|
|
618
|
1744 |
using lemma \ref{sfauIdemDer}.
|
|
|
1745 |
This equality enables the inductive case to go through.
|
|
558
|
1746 |
\end{proof}
|
|
|
1747 |
\noindent
|
|
618
|
1748 |
This lemma says that $(r_1\cdot r_2)\backslash s$
|
|
|
1749 |
can be flattened into a list whose head and tail meet the description
|
|
|
1750 |
we gave earlier.
|
|
|
1751 |
%Note that this lemma does $\mathbf{not}$ depend on any
|
|
|
1752 |
%specific definitions we used,
|
|
|
1753 |
%allowing people investigating derivatives to get an alternative
|
|
|
1754 |
%view of what $r_1 \cdot r_2$ is.
|
|
532
|
1755 |
|
|
618
|
1756 |
We now use $\textit{createdBySequence}$ and
|
|
|
1757 |
$\sflataux{\_}$ to describe an intuition
|
|
|
1758 |
behind the closed form of the sequence closed form.
|
|
|
1759 |
If two regular expressions only differ in the way their
|
|
|
1760 |
alternatives are nested, then we should be able to get the same result
|
|
|
1761 |
once we apply simplification to both of them:
|
|
|
1762 |
\begin{lemma}\label{sflatRsimpeq}
|
|
|
1763 |
If $r$ is created from a sequence through
|
|
|
1764 |
a series of derivatives
|
|
|
1765 |
(i.e. if $\textit{createdBySequence} \; r$ holds),
|
|
|
1766 |
and that $\sflataux{r} = rs$,
|
|
|
1767 |
then we have
|
|
|
1768 |
that
|
|
|
1769 |
\begin{center}
|
|
|
1770 |
$\textit{rsimp} \; r = \textit{rsimp} \; (\sum \; rs)$
|
|
|
1771 |
\end{center}
|
|
|
1772 |
holds.
|
|
|
1773 |
\end{lemma}
|
|
|
1774 |
\begin{proof}
|
|
|
1775 |
By an induction on the inductive cases of $\textit{createdBySequence}$.
|
|
|
1776 |
\end{proof}
|
|
|
1777 |
|
|
|
1778 |
Now we are ready for the closed form
|
|
|
1779 |
for the sequence regular expressions (without the inner applications
|
|
|
1780 |
of simplifications):
|
|
|
1781 |
\begin{lemma}\label{seqClosedFormGeneral}
|
|
558
|
1782 |
$\rsimp{\sflat{(r_1 \cdot r_2) \backslash s} }
|
|
|
1783 |
=\rsimp{(\sum ( (r_1 \backslash s) \cdot r_2 ::
|
|
593
|
1784 |
\map\; (r_2 \backslash \_) \; (\vsuf{s}{r_1})))}$
|
|
558
|
1785 |
\end{lemma}
|
|
|
1786 |
\begin{proof}
|
|
618
|
1787 |
We know that
|
|
|
1788 |
$\sflataux{(r_1 \cdot r_2) \backslash_r s} = (r_1 \backslash_r s) \cdot r_2
|
|
|
1789 |
:: (\map \; (r_2 \backslash_r \_) \; (\textit{Suffix} \; s \; r1))$
|
|
|
1790 |
holds
|
|
|
1791 |
by lemma \ref{seqSfau0}.
|
|
|
1792 |
This allows the theorem to go through because of lemma \ref{sflatRsimpeq}.
|
|
558
|
1793 |
\end{proof}
|
|
618
|
1794 |
Together with the idempotency property of $\rsimp{}$ (lemma \ref{rsimpIdem}),
|
|
|
1795 |
it is possible to convert the above lemma to obtain the
|
|
|
1796 |
proper closed form for $\backslash_{rsimps}$ rather than $\backslash_r$:
|
|
|
1797 |
for derivatives nested with simplification:
|
|
|
1798 |
\begin{theorem}\label{seqClosedForm}
|
|
|
1799 |
$\rderssimp{(r_1 \cdot r_2)}{s} = \rsimp{(\sum ((r_1 \backslash s) \cdot r_2 )
|
|
|
1800 |
:: (\map \; (r_2 \backslash \_) (\vsuf{s}{r_1})))}$
|
|
|
1801 |
\end{theorem}
|
|
|
1802 |
\begin{proof}
|
|
|
1803 |
By a case analysis of the string $s$.
|
|
|
1804 |
When $s$ is an empty list, the rewrite is straightforward.
|
|
|
1805 |
When $s$ is a non-empty list, the
|
|
|
1806 |
lemmas \ref{seqClosedFormGeneral} and \ref{Simpders} apply,
|
|
|
1807 |
making the proof go through.
|
|
|
1808 |
\end{proof}
|
|
609
|
1809 |
\subsubsection{Closed Forms for Star Regular Expressions}
|
|
618
|
1810 |
The closed form for the star regular expression involves similar tricks
|
|
|
1811 |
for the sequence regular expression.
|
|
|
1812 |
The $\textit{Suffix}$ function is now replaced by something
|
|
|
1813 |
slightly more complex, because the growth pattern of star
|
|
|
1814 |
regular expressions' derivatives is a bit different:
|
|
564
|
1815 |
\begin{center}
|
|
618
|
1816 |
\begin{tabular}{lclc}
|
|
|
1817 |
$r^* $ & $\longrightarrow_{\backslash c}$ &
|
|
|
1818 |
$(r\backslash c) \cdot r^*$ & $\longrightarrow_{\backslash c'}$\\
|
|
|
1819 |
\\
|
|
|
1820 |
$r \backslash cc' \cdot r^* + r \backslash c' \cdot r^*$ &
|
|
|
1821 |
$\longrightarrow_{\backslash c''}$ &
|
|
|
1822 |
$(r_1 \backslash cc'c'' \cdot r^* + r \backslash c'') +
|
|
|
1823 |
(r \backslash c'c'' \cdot r^* + r \backslash c'' \cdot r^*)$ &
|
|
|
1824 |
$\longrightarrow_{\backslash c'''}$ \\
|
|
|
1825 |
\\
|
|
|
1826 |
$\ldots$\\
|
|
|
1827 |
\end{tabular}
|
|
564
|
1828 |
\end{center}
|
|
|
1829 |
When we have a string $s = c :: c' :: c'' \ldots$ such that $r \backslash c$, $r \backslash cc'$, $r \backslash c'$,
|
|
|
1830 |
$r \backslash cc'c''$, $r \backslash c'c''$, $r\backslash c''$ etc. are all nullable,
|
|
618
|
1831 |
the number of terms in $r^* \backslash s$ will grow exponentially rather than linearly
|
|
|
1832 |
in the sequence case.
|
|
|
1833 |
The good news is that the function $\textit{rsimp}$ will again
|
|
|
1834 |
ignore the difference between differently nesting patterns of alternatives,
|
|
|
1835 |
and the exponentially growing star derivative like
|
|
|
1836 |
\begin{center}
|
|
|
1837 |
$(r_1 \backslash cc'c'' \cdot r^* + r \backslash c'') +
|
|
|
1838 |
(r \backslash c'c'' \cdot r^* + r \backslash c'' \cdot r^*) $
|
|
|
1839 |
\end{center}
|
|
|
1840 |
can be treated as
|
|
|
1841 |
\begin{center}
|
|
|
1842 |
$\RALTS{[r_1 \backslash cc'c'' \cdot r^*, r \backslash c'',
|
|
|
1843 |
r \backslash c'c'' \cdot r^*, r \backslash c'' \cdot r^*]}$
|
|
|
1844 |
\end{center}
|
|
|
1845 |
which can be de-duplicated by $\rDistinct$
|
|
|
1846 |
and therefore bounded finitely.
|
|
564
|
1847 |
|
|
618
|
1848 |
and then de-duplicate terms of the form ($s'$ being a substring of $s$).
|
|
564
|
1849 |
This allows us to use a similar technique as $r_1 \cdot r_2$ case,
|
|
618
|
1850 |
|
|
|
1851 |
Now the crux of this section is finding a suitable description
|
|
|
1852 |
for $rs$ where
|
|
|
1853 |
\begin{center}
|
|
|
1854 |
$\rderssimp{r^*}{s} = \rsimp{\sum rs}$.
|
|
|
1855 |
\end{center}
|
|
|
1856 |
holds.
|
|
|
1857 |
In addition, the list $rs$
|
|
|
1858 |
shall be in the form of
|
|
|
1859 |
$\map \; (\lambda s'. r\backslash s' \cdot r^*) \; Ss$.
|
|
|
1860 |
The $Ss$ is a list of strings, and for example in the sequence
|
|
|
1861 |
closed form it is specified as $\textit{Suffix} \; s \; r_1$.
|
|
|
1862 |
To get $Ss$ for the star regular expression,
|
|
|
1863 |
we need to introduce $\starupdate$ and $\starupdates$:
|
|
558
|
1864 |
\begin{center}
|
|
|
1865 |
\begin{tabular}{lcl}
|
|
|
1866 |
$\starupdate \; c \; r \; [] $ & $\dn$ & $[]$\\
|
|
|
1867 |
$\starupdate \; c \; r \; (s :: Ss)$ & $\dn$ & \\
|
|
|
1868 |
& & $\textit{if} \;
|
|
620
|
1869 |
(\rnullable \; (r \backslash_{rs} s))$ \\
|
|
558
|
1870 |
& & $\textit{then} \;\; (s @ [c]) :: [c] :: (
|
|
|
1871 |
\starupdate \; c \; r \; Ss)$ \\
|
|
|
1872 |
& & $\textit{else} \;\; (s @ [c]) :: (
|
|
|
1873 |
\starupdate \; c \; r \; Ss)$
|
|
|
1874 |
\end{tabular}
|
|
|
1875 |
\end{center}
|
|
|
1876 |
\begin{center}
|
|
|
1877 |
\begin{tabular}{lcl}
|
|
|
1878 |
$\starupdates \; [] \; r \; Ss$ & $=$ & $Ss$\\
|
|
|
1879 |
$\starupdates \; (c :: cs) \; r \; Ss$ & $=$ & $\starupdates \; cs \; r \; (
|
|
|
1880 |
\starupdate \; c \; r \; Ss)$
|
|
|
1881 |
\end{tabular}
|
|
|
1882 |
\end{center}
|
|
|
1883 |
\noindent
|
|
618
|
1884 |
Assuming we have that
|
|
|
1885 |
\begin{center}
|
|
|
1886 |
$\rderssimp{r^*}{s} = \rsimp{(\sum \map \; (\lambda s'. r\backslash s' \cdot r^*) \; Ss)}$.
|
|
|
1887 |
\end{center}
|
|
|
1888 |
holds.
|
|
|
1889 |
The idea of $\starupdate$ and $\starupdates$
|
|
|
1890 |
is to update $Ss$ when another
|
|
|
1891 |
derivative is taken on $\rderssimp{r^*}{s}$
|
|
|
1892 |
w.r.t a character $c$ and a string $s'$
|
|
|
1893 |
respectively.
|
|
|
1894 |
Both $\starupdate$ and $\starupdates$ take three arguments as input:
|
|
|
1895 |
the new character $c$ or string $s$ to take derivative with,
|
|
|
1896 |
the regular expression
|
|
|
1897 |
$r$ under the star $r^*$, and the
|
|
|
1898 |
list of strings $Ss$ for the derivative $r^* \backslash s$
|
|
|
1899 |
up until this point
|
|
|
1900 |
such that
|
|
|
1901 |
\begin{center}
|
|
|
1902 |
$(r^*) \backslash s = \sum_{s' \in sSet} (r\backslash s') \cdot r^*$
|
|
|
1903 |
\end{center}
|
|
|
1904 |
is satisfied.
|
|
|
1905 |
|
|
|
1906 |
Functions $\starupdate$ and $\starupdates$ characterise what the
|
|
|
1907 |
star derivatives will look like once ``straightened out'' into lists.
|
|
|
1908 |
The helper functions for such operations will be similar to
|
|
|
1909 |
$\sflat{\_}$, $\sflataux{\_}$ and $\sflataux{\_}$, which we defined for sequence.
|
|
|
1910 |
We use similar symbols to denote them, with a $*$ subscript to mark the difference.
|
|
558
|
1911 |
\begin{center}
|
|
|
1912 |
\begin{tabular}{lcl}
|
|
|
1913 |
$\hflataux{r_1 + r_2}$ & $\dn$ & $\hflataux{r_1} @ \hflataux{r_2}$\\
|
|
|
1914 |
$\hflataux{r}$ & $\dn$ & $[r]$
|
|
|
1915 |
\end{tabular}
|
|
|
1916 |
\end{center}
|
|
557
|
1917 |
|
|
|
1918 |
\begin{center}
|
|
558
|
1919 |
\begin{tabular}{lcl}
|
|
|
1920 |
$\hflat{r_1 + r_2}$ & $\dn$ & $\sum (\hflataux {r_1} @ \hflataux {r_2}) $\\
|
|
|
1921 |
$\hflat{r}$ & $\dn$ & $r$
|
|
|
1922 |
\end{tabular}
|
|
|
1923 |
\end{center}
|
|
|
1924 |
\noindent
|
|
618
|
1925 |
These definitions are tailor-made for dealing with alternatives that have
|
|
|
1926 |
originated from a star's derivatives.
|
|
|
1927 |
A typical star derivative always has the structure of a balanced binary tree:
|
|
564
|
1928 |
\begin{center}
|
|
618
|
1929 |
$(r_1 \backslash cc'c'' \cdot r^* + r \backslash c'') +
|
|
|
1930 |
(r \backslash c'c'' \cdot r^* + r \backslash c'' \cdot r^*) $
|
|
593
|
1931 |
\end{center}
|
|
618
|
1932 |
All of the nested structures of alternatives
|
|
|
1933 |
generated from derivatives are binary, and therefore
|
|
|
1934 |
$\hflat{\_}$ and $\hflataux{\_}$ only deal with binary alternatives.
|
|
|
1935 |
$\hflat{\_}$ ``untangles'' like the following:
|
|
|
1936 |
\[
|
|
|
1937 |
\sum ((r_1 + r_2) + (r_3 + r_4)) + \ldots \;
|
|
|
1938 |
\stackrel{\hflat{\_}}{\longrightarrow} \;
|
|
|
1939 |
\RALTS{[r_1, r_2, \ldots, r_n]}
|
|
|
1940 |
\]
|
|
|
1941 |
Here is a lemma stating the recursive property of $\starupdate$ and $\starupdates$,
|
|
|
1942 |
with the helpers $\hflat{\_}$ and $\hflataux{\_}$\footnote{The function $\textit{concat}$ takes a list of lists
|
|
|
1943 |
and merges each of the element lists to form a flattened list.}:
|
|
|
1944 |
\begin{lemma}\label{stupdateInduct1}
|
|
|
1945 |
\mbox
|
|
|
1946 |
For a list of strings $Ss$, the following hold.
|
|
|
1947 |
\begin{itemize}
|
|
|
1948 |
\item
|
|
|
1949 |
If we do a derivative on the terms
|
|
|
1950 |
$r\backslash_r s \cdot r^*$ (where $s$ is taken from the list $Ss$),
|
|
|
1951 |
the result will be the same as if we apply $\starupdate$ to $Ss$.
|
|
|
1952 |
\begin{center}
|
|
|
1953 |
\begin{tabular}{c}
|
|
|
1954 |
$\textit{concat} \; (\map \; (\hflataux{\_} \circ ( (\_\backslash_r x)
|
|
|
1955 |
\circ (\lambda s.\;\; (r \backslash_r s) \cdot r^*)))\; Ss )\;
|
|
|
1956 |
$\\
|
|
|
1957 |
\\
|
|
|
1958 |
$=$ \\
|
|
|
1959 |
\\
|
|
|
1960 |
$\map \; (\lambda s. (r \backslash_r s) \cdot (r^*)) \;
|
|
|
1961 |
(\starupdate \; x \; r \; Ss)$
|
|
|
1962 |
\end{tabular}
|
|
|
1963 |
\end{center}
|
|
|
1964 |
\item
|
|
|
1965 |
$\starupdates$ is ``composable'' w.r.t a derivative.
|
|
|
1966 |
It piggybacks the character $x$ to the tail of the string
|
|
|
1967 |
$xs$.
|
|
|
1968 |
\begin{center}
|
|
|
1969 |
\begin{tabular}{c}
|
|
|
1970 |
$\textit{concat} \; (\map \; \hflataux{\_} \;
|
|
|
1971 |
(\map \; (\_\backslash_r x) \;
|
|
|
1972 |
(\map \; (\lambda s.\;\; (r \backslash_r s) \cdot
|
|
|
1973 |
(r^*) ) \; (\starupdates \; xs \; r \; Ss))))$\\
|
|
|
1974 |
\\
|
|
|
1975 |
$=$\\
|
|
|
1976 |
\\
|
|
|
1977 |
$\map \; (\lambda s.\;\; (r\backslash_r s) \cdot (r^*)) \;
|
|
|
1978 |
(\starupdates \; (xs @ [x]) \; r \; Ss)$
|
|
|
1979 |
\end{tabular}
|
|
|
1980 |
\end{center}
|
|
|
1981 |
\end{itemize}
|
|
|
1982 |
\end{lemma}
|
|
|
1983 |
|
|
|
1984 |
\begin{proof}
|
|
|
1985 |
Part 1 is by induction on $Ss$.
|
|
|
1986 |
Part 2 is by induction on $xs$, where $Ss$ is left to take arbitrary values.
|
|
|
1987 |
\end{proof}
|
|
|
1988 |
|
|
593
|
1989 |
|
|
618
|
1990 |
Like $\textit{createdBySequence}$, we need
|
|
|
1991 |
a predicate for ``star-created'' regular expressions:
|
|
593
|
1992 |
\begin{center}
|
|
618
|
1993 |
\begin{mathpar}
|
|
|
1994 |
\inferrule{\mbox{}}{ \textit{createdByStar}\; \RSEQ{ra}{\RSTAR{rb}} }
|
|
|
1995 |
|
|
|
1996 |
\inferrule{ \textit{createdByStar} \; r_1\; \land \; \textit{createdByStar} \; r_2 }{\textit{createdByStar} \; (r_1 + r_2) }
|
|
|
1997 |
\end{mathpar}
|
|
593
|
1998 |
\end{center}
|
|
618
|
1999 |
\noindent
|
|
|
2000 |
All regular expressions created by taking derivatives of
|
|
|
2001 |
$r_1 \cdot (r_2)^*$ satisfy the $\textit{createdByStar}$ predicate:
|
|
|
2002 |
\begin{lemma}\label{starDersCbs}
|
|
|
2003 |
$\textit{createdByStar} \; ((r_1 \cdot r_2^*) \backslash_r s) $ holds.
|
|
|
2004 |
\end{lemma}
|
|
|
2005 |
\begin{proof}
|
|
|
2006 |
By a reverse induction on $s$.
|
|
|
2007 |
\end{proof}
|
|
|
2008 |
If a regular expression conforms to the shape of a star's derivative,
|
|
|
2009 |
then we can push an application of $\hflataux{\_}$ inside a derivative of it:
|
|
|
2010 |
\begin{lemma}\label{hfauPushin}
|
|
|
2011 |
If $\textit{createdByStar} \; r$ holds, then
|
|
|
2012 |
\begin{center}
|
|
|
2013 |
$\hflataux{r \backslash_r c} = \textit{concat} \; (
|
|
|
2014 |
\map \; \hflataux{\_} (\map \; (\_\backslash_r c) \;(\hflataux{r})))$
|
|
|
2015 |
\end{center}
|
|
|
2016 |
holds.
|
|
|
2017 |
\end{lemma}
|
|
|
2018 |
\begin{proof}
|
|
|
2019 |
By an induction on the inductivev cases of $\textit{createdByStar}$.
|
|
|
2020 |
\end{proof}
|
|
|
2021 |
%This is not entirely true for annotated regular expressions:
|
|
|
2022 |
%%TODO: bsimp bders \neq bderssimp
|
|
|
2023 |
%\begin{center}
|
|
|
2024 |
% $(1+ (c\cdot \ASEQ{bs}{c^*}{c} ))$
|
|
|
2025 |
%\end{center}
|
|
|
2026 |
%For bit-codes, the order in which simplification is applied
|
|
|
2027 |
%might cause a difference in the location they are placed.
|
|
|
2028 |
%If we want something like
|
|
|
2029 |
%\begin{center}
|
|
|
2030 |
% $\bderssimp{r}{s} \myequiv \bsimp{\bders{r}{s}}$
|
|
|
2031 |
%\end{center}
|
|
|
2032 |
%Some "canonicalization" procedure is required,
|
|
|
2033 |
%which either pushes all the common bitcodes to nodes
|
|
|
2034 |
%as senior as possible:
|
|
|
2035 |
%\begin{center}
|
|
|
2036 |
% $_{bs}(_{bs_1 @ bs'}r_1 + _{bs_1 @ bs''}r_2) \rightarrow _{bs @ bs_1}(_{bs'}r_1 + _{bs''}r_2) $
|
|
|
2037 |
%\end{center}
|
|
|
2038 |
%or does the reverse. However bitcodes are not of interest if we are talking about
|
|
|
2039 |
%the $\llbracket r \rrbracket$ size of a regex.
|
|
|
2040 |
%Therefore for the ease and simplicity of producing a
|
|
|
2041 |
%proof for a size bound, we are happy to restrict ourselves to
|
|
|
2042 |
%unannotated regular expressions, and obtain such equalities as
|
|
|
2043 |
%TODO: rsimp sflat
|
|
|
2044 |
% The simplification of a flattened out regular expression, provided it comes
|
|
|
2045 |
%from the derivative of a star, is the same as the one nested.
|
|
|
2046 |
|
|
|
2047 |
|
|
|
2048 |
|
|
|
2049 |
Now we introduce an inductive property
|
|
|
2050 |
for $\starupdate$ and $\hflataux{\_}$.
|
|
|
2051 |
\begin{lemma}\label{starHfauInduct}
|
|
|
2052 |
If we do derivatives of $r^*$
|
|
|
2053 |
with a string that starts with $c$,
|
|
|
2054 |
then flatten it out,
|
|
|
2055 |
we obtain a list
|
|
|
2056 |
of the shape $\sum_{s' \in sS} (r\backslash_r s') \cdot r^*$,
|
|
|
2057 |
where $sS = \starupdates \; s \; r \; [[c]]$. Namely,
|
|
|
2058 |
\begin{center}
|
|
620
|
2059 |
$\hflataux{(( (\rder{c}{r_0})\cdot(r_0^*))\backslash_{rs} s)} =
|
|
618
|
2060 |
\map \; (\lambda s_1. (r_0 \backslash_r s_1) \cdot (r_0^*)) \;
|
|
|
2061 |
(\starupdates \; s \; r_0 \; [[c]])$
|
|
|
2062 |
\end{center}
|
|
|
2063 |
holds.
|
|
|
2064 |
\end{lemma}
|
|
|
2065 |
\begin{proof}
|
|
|
2066 |
By an induction on $s$, the inductive cases
|
|
|
2067 |
being $[]$ and $s@[c]$. The lemmas \ref{hfauPushin} and \ref{starDersCbs} are used.
|
|
|
2068 |
\end{proof}
|
|
|
2069 |
\noindent
|
|
|
2070 |
|
|
|
2071 |
$\hflataux{\_}$ has a similar effect as $\textit{flatten}$:
|
|
|
2072 |
\begin{lemma}\label{hflatauxGrewrites}
|
|
|
2073 |
$a :: rs \grewrites \hflataux{a} @ rs$
|
|
|
2074 |
\end{lemma}
|
|
|
2075 |
\begin{proof}
|
|
|
2076 |
By induction on $a$. $rs$ is set to take arbitrary values.
|
|
|
2077 |
\end{proof}
|
|
|
2078 |
It is also not surprising that $\textit{rsimp}$ will cover
|
|
|
2079 |
the effect of $\hflataux{\_}$:
|
|
|
2080 |
\begin{lemma}\label{cbsHfauRsimpeq1}
|
|
|
2081 |
$\rsimp{(r_1 + r_2)} = \rsimp{(\RALTS{\hflataux{r_1} @ \hflataux{r_2}})}$
|
|
593
|
2082 |
\end{lemma}
|
|
|
2083 |
|
|
|
2084 |
\begin{proof}
|
|
|
2085 |
By using the rewriting relation $\rightsquigarrow$
|
|
|
2086 |
\end{proof}
|
|
564
|
2087 |
And from this we obtain a proof that a star's derivative will be the same
|
|
|
2088 |
as if it had all its nested alternatives created during deriving being flattened out:
|
|
593
|
2089 |
For example,
|
|
618
|
2090 |
\begin{lemma}\label{hfauRsimpeq2}
|
|
593
|
2091 |
$\createdByStar{r} \implies \rsimp{r} = \rsimp{\RALTS{\hflataux{r}}}$
|
|
|
2092 |
\end{lemma}
|
|
|
2093 |
\begin{proof}
|
|
618
|
2094 |
By structural induction on $r$, where the induction rules
|
|
|
2095 |
are these of $\createdByStar{\_}$.
|
|
|
2096 |
Lemma \ref{cbsHfauRsimpeq1} is used in the inductive case.
|
|
593
|
2097 |
\end{proof}
|
|
564
|
2098 |
|
|
|
2099 |
|
|
618
|
2100 |
%Here is a corollary that states the lemma in
|
|
|
2101 |
%a more intuitive way:
|
|
|
2102 |
%\begin{corollary}
|
|
|
2103 |
% $\hflataux{r^* \backslash_r (c::xs)} = \map \; (\lambda s. (r \backslash_r s) \cdot
|
|
|
2104 |
% (r^*))\; (\starupdates \; c\; r\; [[c]])$
|
|
|
2105 |
%\end{corollary}
|
|
|
2106 |
%\noindent
|
|
|
2107 |
%Note that this is also agnostic of the simplification
|
|
|
2108 |
%function we defined, and is therefore of more general interest.
|
|
|
2109 |
|
|
|
2110 |
Together with the rewriting relation
|
|
|
2111 |
\begin{lemma}\label{starClosedForm6Hrewrites}
|
|
|
2112 |
We have the following set of rewriting relations or equalities:
|
|
|
2113 |
\begin{itemize}
|
|
|
2114 |
\item
|
|
|
2115 |
$\textit{rsimp} \; (r^* \backslash_r (c::s))
|
|
|
2116 |
\sequal
|
|
|
2117 |
\sum \; ( ( \sum (\lambda s. (r\backslash_r s) \cdot r^*) \; (
|
|
|
2118 |
\starupdates \; s \; r \; [ c::[]] ) ) )$
|
|
|
2119 |
\item
|
|
620
|
2120 |
$r \backslash_{rsimps} (c::s) = \textit{rsimp} \; ( (
|
|
618
|
2121 |
\sum ( (\map \; (\lambda s_1. (r\backslash s_1) \; r^*) \;
|
|
|
2122 |
(\starupdates \;s \; r \; [ c::[] ])))))$
|
|
|
2123 |
\item
|
|
|
2124 |
$\sum ( (\map \; (\lambda s. (r\backslash s) \; r^*) \; Ss))
|
|
|
2125 |
\sequal
|
|
|
2126 |
\sum ( (\map \; (\lambda s. \textit{rsimp} \; (r\backslash s) \;
|
|
|
2127 |
r^*) \; Ss) )$
|
|
|
2128 |
\item
|
|
|
2129 |
$\map \; (\lambda s. (\rsimp{r \backslash_r s}) \cdot (r^*)) \; Ss
|
|
|
2130 |
\scfrewrites
|
|
|
2131 |
\map \; (\lambda s. (\rsimp{r \backslash_r s}) \cdot (r^*)) \; Ss$
|
|
|
2132 |
\item
|
|
|
2133 |
$( ( \sum ( ( \map \ (\lambda s. \;\;
|
|
|
2134 |
(\textit{rsimp} \; (r \backslash_r s)) \cdot r^*) \; (\starupdates \;
|
|
|
2135 |
s \; r \; [ c::[] ])))))$\\
|
|
|
2136 |
$\sequal$\\
|
|
|
2137 |
$( ( \sum ( ( \map \ (\lambda s. \;\;
|
|
620
|
2138 |
( r \backslash_{rsimps} s)) \cdot r^*) \; (\starupdates \;
|
|
618
|
2139 |
s \; r \; [ c::[] ]))))$\\
|
|
|
2140 |
\end{itemize}
|
|
558
|
2141 |
\end{lemma}
|
|
|
2142 |
\begin{proof}
|
|
618
|
2143 |
Part 1 leads to part 2.
|
|
|
2144 |
The rest of them are routine.
|
|
558
|
2145 |
\end{proof}
|
|
|
2146 |
\noindent
|
|
618
|
2147 |
Next the closed form for star regular expressions can be derived:
|
|
|
2148 |
\begin{theorem}\label{starClosedForm}
|
|
558
|
2149 |
$\rderssimp{r^*}{c::s} =
|
|
|
2150 |
\rsimp{
|
|
|
2151 |
(\sum (\map \; (\lambda s. (\rderssimp{r}{s})\cdot r^*) \;
|
|
593
|
2152 |
(\starupdates \; s\; r \; [[c]])
|
|
558
|
2153 |
)
|
|
593
|
2154 |
)
|
|
|
2155 |
}
|
|
558
|
2156 |
$
|
|
618
|
2157 |
\end{theorem}
|
|
558
|
2158 |
\begin{proof}
|
|
|
2159 |
By an induction on $s$.
|
|
618
|
2160 |
The lemmas \ref{rsimpIdem}, \ref{starHfauInduct}, \ref{starClosedForm6Hrewrites}
|
|
|
2161 |
and \ref{hfauRsimpeq2}
|
|
558
|
2162 |
are used.
|
|
618
|
2163 |
In \ref{starClosedForm6Hrewrites}, the equalities are
|
|
|
2164 |
used to link the LHS and RHS.
|
|
558
|
2165 |
\end{proof}
|
|
609
|
2166 |
|
|
|
2167 |
|
|
|
2168 |
|
|
|
2169 |
|
|
|
2170 |
|
|
|
2171 |
|
|
613
|
2172 |
%----------------------------------------------------------------------------------------
|
|
|
2173 |
% SECTION ??
|
|
|
2174 |
%----------------------------------------------------------------------------------------
|
|
|
2175 |
|
|
|
2176 |
%-----------------------------------
|
|
|
2177 |
% SECTION syntactic equivalence under simp
|
|
|
2178 |
%-----------------------------------
|
|
|
2179 |
|
|
|
2180 |
|
|
|
2181 |
%----------------------------------------------------------------------------------------
|
|
|
2182 |
% SECTION ALTS CLOSED FORM
|
|
|
2183 |
%----------------------------------------------------------------------------------------
|
|
|
2184 |
%\section{A Closed Form for \textit{ALTS}}
|
|
|
2185 |
%Now we prove that $rsimp (rders\_simp (RALTS rs) s) = rsimp (RALTS (map (\lambda r. rders\_simp r s) rs))$.
|
|
|
2186 |
%
|
|
|
2187 |
%
|
|
|
2188 |
%There are a few key steps, one of these steps is
|
|
|
2189 |
%
|
|
|
2190 |
%
|
|
|
2191 |
%
|
|
|
2192 |
%One might want to prove this by something a simple statement like:
|
|
|
2193 |
%
|
|
|
2194 |
%For this to hold we want the $\textit{distinct}$ function to pick up
|
|
|
2195 |
%the elements before and after derivatives correctly:
|
|
|
2196 |
%$r \in rset \equiv (rder x r) \in (rder x rset)$.
|
|
|
2197 |
%which essentially requires that the function $\backslash$ is an injective mapping.
|
|
|
2198 |
%
|
|
|
2199 |
%Unfortunately the function $\backslash c$ is not an injective mapping.
|
|
|
2200 |
%
|
|
|
2201 |
%\subsection{function $\backslash c$ is not injective (1-to-1)}
|
|
|
2202 |
%\begin{center}
|
|
|
2203 |
% The derivative $w.r.t$ character $c$ is not one-to-one.
|
|
|
2204 |
% Formally,
|
|
|
2205 |
% $\exists r_1 \;r_2. r_1 \neq r_2 \mathit{and} r_1 \backslash c = r_2 \backslash c$
|
|
|
2206 |
%\end{center}
|
|
|
2207 |
%This property is trivially true for the
|
|
|
2208 |
%character regex example:
|
|
|
2209 |
%\begin{center}
|
|
|
2210 |
% $r_1 = e; \; r_2 = d;\; r_1 \backslash c = \ZERO = r_2 \backslash c$
|
|
|
2211 |
%\end{center}
|
|
|
2212 |
%But apart from the cases where the derivative
|
|
|
2213 |
%output is $\ZERO$, are there non-trivial results
|
|
|
2214 |
%of derivatives which contain strings?
|
|
|
2215 |
%The answer is yes.
|
|
|
2216 |
%For example,
|
|
|
2217 |
%\begin{center}
|
|
|
2218 |
% Let $r_1 = a^*b\;\quad r_2 = (a\cdot a^*)\cdot b + b$.\\
|
|
|
2219 |
% where $a$ is not nullable.\\
|
|
|
2220 |
% $r_1 \backslash c = ((a \backslash c)\cdot a^*)\cdot c + b \backslash c$\\
|
|
|
2221 |
% $r_2 \backslash c = ((a \backslash c)\cdot a^*)\cdot c + b \backslash c$
|
|
|
2222 |
%\end{center}
|
|
|
2223 |
%We start with two syntactically different regular expressions,
|
|
|
2224 |
%and end up with the same derivative result.
|
|
|
2225 |
%This is not surprising as we have such
|
|
|
2226 |
%equality as below in the style of Arden's lemma:\\
|
|
|
2227 |
%\begin{center}
|
|
|
2228 |
% $L(A^*B) = L(A\cdot A^* \cdot B + B)$
|
|
|
2229 |
%\end{center}
|
|
|
2230 |
\section{Bounding Closed Forms}
|
|
|
2231 |
|
|
|
2232 |
In this section, we introduce how we formalised the bound
|
|
|
2233 |
on closed forms.
|
|
618
|
2234 |
We first show that in general regular expressions up to a certain
|
|
|
2235 |
size are finite.
|
|
|
2236 |
Then we prove that functions such as $\rflts$
|
|
613
|
2237 |
will not cause the size of r-regular expressions to grow.
|
|
|
2238 |
Putting this together with a general bound
|
|
|
2239 |
on the finiteness of distinct regular expressions
|
|
618
|
2240 |
up to a certain size, we obtain a bound on
|
|
613
|
2241 |
the closed forms.
|
|
|
2242 |
|
|
618
|
2243 |
\subsection{Finiteness of Distinct Regular Expressions}
|
|
|
2244 |
We define the set of regular expressions whose size are no more than
|
|
|
2245 |
a certain size $N$ as $\textit{sizeNregex} \; N$:
|
|
|
2246 |
\[
|
|
|
2247 |
\textit{sizeNregex} \; N \dn \{r\; \mid \; \llbracket r \rrbracket_r \leq N \}
|
|
|
2248 |
\]
|
|
|
2249 |
We have that $\textit{sizeNregex} \; N$ is always a finite set:
|
|
|
2250 |
\begin{lemma}\label{finiteSizeN}
|
|
|
2251 |
$\textit{finite} \; (\textit{sizeNregex} \; N)$ holds.
|
|
|
2252 |
\end{lemma}
|
|
|
2253 |
\begin{proof}
|
|
|
2254 |
By splitting the set $\textit{sizeNregex} \; (N + 1)$ into
|
|
|
2255 |
subsets by their categories:
|
|
|
2256 |
$\{\ZERO, \ONE, c\}$, $\{* `` \textit{sizeNregex} \; N\}$,
|
|
|
2257 |
and so on. Each of these subsets are finitely bounded.
|
|
|
2258 |
\end{proof}
|
|
|
2259 |
\noindent
|
|
|
2260 |
From this we get a corollary that
|
|
|
2261 |
if forall $r \in rs$, $\rsize{r} \leq N$, then the output of
|
|
|
2262 |
$\rdistinct{rs}{\varnothing}$ is a list of regular
|
|
|
2263 |
expressions of finite size depending on $N$ only.
|
|
|
2264 |
\begin{corollary}\label{finiteSizeNCorollary}
|
|
|
2265 |
$\rsize{\rdistinct{rs}{\varnothing}} \leq c_N * N$ holds,
|
|
|
2266 |
where the constant $c_N$ is equal to $\textit{card} \; (\textit{sizeNregex} \;
|
|
|
2267 |
N)$.
|
|
|
2268 |
\end{corollary}
|
|
|
2269 |
\begin{proof}
|
|
|
2270 |
For all $r$ in
|
|
|
2271 |
$\textit{set} \; (\rdistinct{rs}{\varnothing})$,
|
|
|
2272 |
it is always the case that $\rsize{r} \leq N$.
|
|
|
2273 |
In addition, the list length is bounded by
|
|
|
2274 |
$c_N$, yielding the desired bound.
|
|
|
2275 |
\end{proof}
|
|
|
2276 |
\noindent
|
|
|
2277 |
This fact will be handy in estimating the closed form sizes.
|
|
|
2278 |
%We have proven that the size of the
|
|
|
2279 |
%output of $\textit{rdistinct} \; rs' \; \varnothing$
|
|
|
2280 |
%is bounded by a constant $N * c_N$ depending only on $N$,
|
|
|
2281 |
%provided that each of $rs'$'s element
|
|
|
2282 |
%is bounded by $N$.
|
|
|
2283 |
|
|
613
|
2284 |
\subsection{$\textit{rsimp}$ Does Not Increment the Size}
|
|
|
2285 |
Although it seems evident, we need a series
|
|
|
2286 |
of non-trivial lemmas to establish that functions such as $\rflts$
|
|
|
2287 |
do not cause the regular expressions to grow.
|
|
|
2288 |
\begin{lemma}\label{rsimpMonoLemmas}
|
|
|
2289 |
\mbox{}
|
|
|
2290 |
\begin{itemize}
|
|
|
2291 |
\item
|
|
|
2292 |
\[
|
|
|
2293 |
\llbracket \rsimpalts \; rs \rrbracket_r \leq
|
|
|
2294 |
\llbracket \sum \; rs \rrbracket_r
|
|
|
2295 |
\]
|
|
|
2296 |
\item
|
|
|
2297 |
\[
|
|
|
2298 |
\llbracket \rsimpseq \; r_1 \; r_2 \rrbracket_r \leq
|
|
|
2299 |
\llbracket r_1 \cdot r_2 \rrbracket_r
|
|
|
2300 |
\]
|
|
|
2301 |
\item
|
|
|
2302 |
\[
|
|
|
2303 |
\llbracket \rflts \; rs \rrbracket_r \leq
|
|
|
2304 |
\llbracket rs \rrbracket_r
|
|
|
2305 |
\]
|
|
|
2306 |
\item
|
|
|
2307 |
\[
|
|
|
2308 |
\llbracket \rDistinct \; rs \; ss \rrbracket_r \leq
|
|
|
2309 |
\llbracket rs \rrbracket_r
|
|
|
2310 |
\]
|
|
|
2311 |
\item
|
|
|
2312 |
If all elements $a$ in the set $as$ satisfy the property
|
|
|
2313 |
that $\llbracket \textit{rsimp} \; a \rrbracket_r \leq
|
|
|
2314 |
\llbracket a \rrbracket_r$, then we have
|
|
|
2315 |
\[
|
|
|
2316 |
\llbracket \; \rsimpalts \; (\textit{rdistinct} \;
|
|
|
2317 |
(\textit{rflts} \; (\textit{map}\;\textit{rsimp} as)) \{\})
|
|
|
2318 |
\rrbracket \leq
|
|
|
2319 |
\llbracket \; \sum \; (\rDistinct \; (\rflts \;(\map \;
|
|
|
2320 |
\textit{rsimp} \; x))\; \{ \} ) \rrbracket_r
|
|
|
2321 |
\]
|
|
|
2322 |
\end{itemize}
|
|
|
2323 |
\end{lemma}
|
|
|
2324 |
\begin{proof}
|
|
|
2325 |
Point 1, 3, 4 can be proven by an induction on $rs$.
|
|
|
2326 |
Point 2 is by case analysis on $r_1$ and $r_2$.
|
|
|
2327 |
The last part is a corollary of the previous ones.
|
|
|
2328 |
\end{proof}
|
|
|
2329 |
\noindent
|
|
|
2330 |
With the lemmas for each inductive case in place, we are ready to get
|
|
|
2331 |
the non-increasing property as a corollary:
|
|
|
2332 |
\begin{corollary}\label{rsimpMono}
|
|
|
2333 |
$\llbracket \textit{rsimp} \; r \rrbracket_r \leq \llbracket r \rrbracket_r$
|
|
|
2334 |
\end{corollary}
|
|
|
2335 |
\begin{proof}
|
|
|
2336 |
By \ref{rsimpMonoLemmas}.
|
|
|
2337 |
\end{proof}
|
|
|
2338 |
|
|
609
|
2339 |
\subsection{Estimating the Closed Forms' sizes}
|
|
618
|
2340 |
We recap the closed forms we obtained
|
|
|
2341 |
earlier by putting them together down below:
|
|
558
|
2342 |
\begin{itemize}
|
|
|
2343 |
\item
|
|
593
|
2344 |
$\rderssimp{(\sum rs)}{s} \sequal
|
|
|
2345 |
\sum \; (\map \; (\rderssimp{\_}{s}) \; rs)$
|
|
558
|
2346 |
\item
|
|
593
|
2347 |
$\rderssimp{(r_1 \cdot r_2)}{s} \sequal \sum ((r_1 \backslash s) \cdot r_2 )
|
|
|
2348 |
:: (\map \; (r_2 \backslash \_) (\vsuf{s}{r_1}))$
|
|
558
|
2349 |
\item
|
|
|
2350 |
|
|
593
|
2351 |
$\rderssimp{r^*}{c::s} =
|
|
|
2352 |
\rsimp{
|
|
|
2353 |
(\sum (\map \; (\lambda s. (\rderssimp{r}{s})\cdot r^*) \;
|
|
558
|
2354 |
(\starupdates \; s\; r \; [[c]])
|
|
593
|
2355 |
)
|
|
|
2356 |
)
|
|
|
2357 |
}
|
|
|
2358 |
$
|
|
558
|
2359 |
\end{itemize}
|
|
|
2360 |
\noindent
|
|
|
2361 |
The closed forms on the left-hand-side
|
|
|
2362 |
are all of the same shape: $\rsimp{ (\sum rs)} $.
|
|
|
2363 |
Such regular expression will be bounded by the size of $\sum rs'$,
|
|
|
2364 |
where every element in $rs'$ is distinct, and each element
|
|
|
2365 |
can be described by some inductive sub-structures
|
|
|
2366 |
(for example when $r = r_1 \cdot r_2$ then $rs'$
|
|
|
2367 |
will be solely comprised of $r_1 \backslash s'$
|
|
|
2368 |
and $r_2 \backslash s''$, $s'$ and $s''$ being
|
|
|
2369 |
sub-strings of $s$).
|
|
|
2370 |
which will each have a size uppder bound
|
|
|
2371 |
according to inductive hypothesis, which controls $r \backslash s$.
|
|
557
|
2372 |
|
|
558
|
2373 |
We elaborate the above reasoning by a series of lemmas
|
|
|
2374 |
below, where straightforward proofs are omitted.
|
|
618
|
2375 |
|
|
|
2376 |
|
|
|
2377 |
|
|
|
2378 |
|
|
558
|
2379 |
We want to apply it to our setting $\rsize{\rsimp{\sum rs}}$.
|
|
|
2380 |
|
|
609
|
2381 |
We show that $\rdistinct$ and $\rflts$
|
|
|
2382 |
working together is at least as
|
|
|
2383 |
good as $\rdistinct{}{}$ alone, which can be written as
|
|
|
2384 |
\begin{center}
|
|
|
2385 |
$\llbracket \rdistinct{(\rflts \; \textit{rs})}{\varnothing} \rrbracket_r
|
|
|
2386 |
\leq
|
|
|
2387 |
\llbracket \rdistinct{rs}{\varnothing} \rrbracket_r $.
|
|
|
2388 |
\end{center}
|
|
|
2389 |
We need this so that we know the outcome of our real
|
|
|
2390 |
simplification is better than or equal to a rough estimate,
|
|
|
2391 |
and therefore can be bounded by that estimate.
|
|
|
2392 |
This is a bit harder to establish compared with proving
|
|
|
2393 |
$\textit{flts}$ does not make a list larger (which can
|
|
|
2394 |
be proven using routine induction):
|
|
|
2395 |
\begin{center}
|
|
|
2396 |
$\llbracket \textit{rflts}\; rs \rrbracket_r \leq
|
|
|
2397 |
\llbracket \textit{rs} \rrbracket_r$
|
|
|
2398 |
\end{center}
|
|
|
2399 |
We cannot simply prove how each helper function
|
|
|
2400 |
reduces the size and then put them together:
|
|
|
2401 |
From
|
|
|
2402 |
\begin{center}
|
|
|
2403 |
$\llbracket \textit{rflts}\; rs \rrbracket_r \leq
|
|
618
|
2404 |
\llbracket \textit{rs} \rrbracket_r$
|
|
609
|
2405 |
\end{center}
|
|
|
2406 |
and
|
|
|
2407 |
\begin{center}
|
|
|
2408 |
$\llbracket \textit{rdistinct} \; rs \; \varnothing \leq
|
|
|
2409 |
\llbracket rs \rrbracket_r$
|
|
|
2410 |
\end{center}
|
|
618
|
2411 |
one cannot infer
|
|
609
|
2412 |
\begin{center}
|
|
558
|
2413 |
$\llbracket \rdistinct{(\rflts \; \textit{rs})}{\varnothing} \rrbracket_r
|
|
|
2414 |
\leq
|
|
|
2415 |
\llbracket \rdistinct{rs}{\varnothing} \rrbracket_r $.
|
|
609
|
2416 |
\end{center}
|
|
618
|
2417 |
What we can infer is that
|
|
609
|
2418 |
\begin{center}
|
|
|
2419 |
$\llbracket \rdistinct{(\rflts \; \textit{rs})}{\varnothing} \rrbracket_r
|
|
|
2420 |
\leq
|
|
|
2421 |
\llbracket rs \rrbracket_r$
|
|
|
2422 |
\end{center}
|
|
|
2423 |
but this estimate is too rough and $\llbracket rs \rrbracket_r$ is unbounded.
|
|
|
2424 |
The way we
|
|
618
|
2425 |
get around this is by first proving a more general lemma
|
|
609
|
2426 |
(so that the inductive case goes through):
|
|
|
2427 |
\begin{lemma}\label{fltsSizeReductionAlts}
|
|
|
2428 |
If we have three accumulator sets:
|
|
|
2429 |
$noalts\_set$, $alts\_set$ and $corr\_set$,
|
|
|
2430 |
satisfying:
|
|
|
2431 |
\begin{itemize}
|
|
|
2432 |
\item
|
|
|
2433 |
$\forall r \in noalts\_set. \; \nexists xs.\; r = \sum xs$
|
|
|
2434 |
\item
|
|
|
2435 |
$\forall r \in alts\_set. \; \exists xs. \; r = \sum xs
|
|
|
2436 |
\; \textit{and} \; set \; xs \subseteq corr\_set$
|
|
|
2437 |
\end{itemize}
|
|
|
2438 |
then we have that
|
|
|
2439 |
\begin{center}
|
|
|
2440 |
\begin{tabular}{lcl}
|
|
|
2441 |
$\llbracket (\textit{rdistinct} \; (\textit{rflts} \; as) \;
|
|
|
2442 |
(noalts\_set \cup corr\_set)) \rrbracket_r$ & $\leq$ &\\
|
|
|
2443 |
$\llbracket (\textit{rdistinct} \; as \; (noalts\_set \cup alts\_set \cup
|
|
|
2444 |
\{ \ZERO \} )) \rrbracket_r$ & & \\
|
|
|
2445 |
\end{tabular}
|
|
|
2446 |
\end{center}
|
|
|
2447 |
holds.
|
|
532
|
2448 |
\end{lemma}
|
|
558
|
2449 |
\noindent
|
|
618
|
2450 |
We split the accumulator into two parts: the part
|
|
609
|
2451 |
which contains alternative regular expressions ($alts\_set$), and
|
|
|
2452 |
the part without any of them($noalts\_set$).
|
|
618
|
2453 |
This is because $\rflts$ opens up the alternatives in $as$,
|
|
|
2454 |
causing the accumulators on both sides of the inequality
|
|
|
2455 |
to diverge slightly.
|
|
|
2456 |
If we want to compare the accumulators that are not
|
|
|
2457 |
perfectly in sync, we need to consider the alternatives and non-alternatives
|
|
|
2458 |
separately.
|
|
609
|
2459 |
The set $corr\_set$ is the corresponding set
|
|
618
|
2460 |
of $alts\_set$ with all elements under the alternative constructor
|
|
609
|
2461 |
spilled out.
|
|
|
2462 |
\begin{proof}
|
|
|
2463 |
By induction on the list $as$. We make use of lemma \ref{rdistinctConcat}.
|
|
|
2464 |
\end{proof}
|
|
|
2465 |
By setting all three sets to the empty set, one gets the desired size estimate:
|
|
|
2466 |
\begin{corollary}\label{interactionFltsDB}
|
|
|
2467 |
$\llbracket \rdistinct{(\rflts \; \textit{rs})}{\varnothing} \rrbracket_r
|
|
|
2468 |
\leq
|
|
|
2469 |
\llbracket \rdistinct{rs}{\varnothing} \rrbracket_r $.
|
|
|
2470 |
\end{corollary}
|
|
|
2471 |
\begin{proof}
|
|
|
2472 |
By using the lemma \ref{fltsSizeReductionAlts}.
|
|
|
2473 |
\end{proof}
|
|
|
2474 |
\noindent
|
|
618
|
2475 |
The intuition for why this is true
|
|
|
2476 |
is that if we remove duplicates from the $\textit{LHS}$, at least the same amount of
|
|
558
|
2477 |
duplicates will be removed from the list $\textit{rs}$ in the $\textit{RHS}$.
|
|
|
2478 |
|
|
|
2479 |
Now this $\rsimp{\sum rs}$ can be estimated using $\rdistinct{rs}{\varnothing}$:
|
|
|
2480 |
\begin{lemma}\label{altsSimpControl}
|
|
|
2481 |
$\rsize{\rsimp{\sum rs}} \leq \rsize{\rdistinct{rs}{\varnothing}}+ 1$
|
|
532
|
2482 |
\end{lemma}
|
|
558
|
2483 |
\begin{proof}
|
|
618
|
2484 |
By using corollary \ref{interactionFltsDB}.
|
|
558
|
2485 |
\end{proof}
|
|
|
2486 |
\noindent
|
|
609
|
2487 |
This is a key lemma in establishing the bounds on all the
|
|
|
2488 |
closed forms.
|
|
|
2489 |
With this we are now ready to control the sizes of
|
|
618
|
2490 |
$(r_1 \cdot r_2 )\backslash s$ and $r^* \backslash s$.
|
|
|
2491 |
\begin{theorem}\label{rBound}
|
|
593
|
2492 |
For any regex $r$, $\exists N_r. \forall s. \; \rsize{\rderssimp{r}{s}} \leq N_r$
|
|
558
|
2493 |
\end{theorem}
|
|
|
2494 |
\noindent
|
|
|
2495 |
\begin{proof}
|
|
593
|
2496 |
We prove this by induction on $r$. The base cases for $\RZERO$,
|
|
|
2497 |
$\RONE $ and $\RCHAR{c}$ are straightforward.
|
|
|
2498 |
In the sequence $r_1 \cdot r_2$ case,
|
|
|
2499 |
the inductive hypotheses state
|
|
|
2500 |
$\exists N_1. \forall s. \; \llbracket \rderssimp{r}{s} \rrbracket \leq N_1$ and
|
|
|
2501 |
$\exists N_2. \forall s. \; \llbracket \rderssimp{r_2}{s} \rrbracket \leq N_2$.
|
|
562
|
2502 |
|
|
593
|
2503 |
When the string $s$ is not empty, we can reason as follows
|
|
|
2504 |
%
|
|
|
2505 |
\begin{center}
|
|
|
2506 |
\begin{tabular}{lcll}
|
|
558
|
2507 |
& & $ \llbracket \rderssimp{r_1\cdot r_2 }{s} \rrbracket_r $\\
|
|
620
|
2508 |
& $ = $ & $\llbracket \rsimp{(\sum(r_1 \backslash_{rsimps} s \cdot r_2 \; \; :: \; \;
|
|
|
2509 |
\map \; (r_2\backslash_{rsimps} \_)\; (\vsuf{s}{r})))} \rrbracket_r $ & (1) \\
|
|
|
2510 |
& $\leq$ & $\llbracket \rdistinct{(r_1 \backslash_{rsimps} s \cdot r_2 \; \; :: \; \;
|
|
|
2511 |
\map \; (r_2\backslash_{rsimps} \_)\; (\vsuf{s}{r}))}{\varnothing} \rrbracket_r + 1$ & (2) \\
|
|
593
|
2512 |
& $\leq$ & $2 + N_1 + \rsize{r_2} + (N_2 * (card\;(\sizeNregex \; N_2)))$ & (3)\\
|
|
558
|
2513 |
\end{tabular}
|
|
|
2514 |
\end{center}
|
|
561
|
2515 |
\noindent
|
|
618
|
2516 |
(1) is by theorem \ref{seqClosedForm}.
|
|
561
|
2517 |
(2) is by \ref{altsSimpControl}.
|
|
|
2518 |
(3) is by \ref{finiteSizeNCorollary}.
|
|
562
|
2519 |
|
|
|
2520 |
|
|
|
2521 |
Combining the cases when $s = []$ and $s \neq []$, we get (4):
|
|
|
2522 |
\begin{center}
|
|
|
2523 |
\begin{tabular}{lcll}
|
|
|
2524 |
$\rsize{(r_1 \cdot r_2) \backslash_r s}$ & $\leq$ &
|
|
|
2525 |
$max \; (2 + N_1 +
|
|
|
2526 |
\llbracket r_2 \rrbracket_r +
|
|
|
2527 |
N_2 * (card\; (\sizeNregex \; N_2))) \; \rsize{r_1\cdot r_2}$ & (4)
|
|
|
2528 |
\end{tabular}
|
|
|
2529 |
\end{center}
|
|
558
|
2530 |
|
|
562
|
2531 |
We reason similarly for $\STAR$.
|
|
|
2532 |
The inductive hypothesis is
|
|
|
2533 |
$\exists N. \forall s. \; \llbracket \rderssimp{r}{s} \rrbracket \leq N$.
|
|
564
|
2534 |
Let $n_r = \llbracket r^* \rrbracket_r$.
|
|
562
|
2535 |
When $s = c :: cs$ is not empty,
|
|
|
2536 |
\begin{center}
|
|
593
|
2537 |
\begin{tabular}{lcll}
|
|
562
|
2538 |
& & $ \llbracket \rderssimp{r^* }{c::cs} \rrbracket_r $\\
|
|
620
|
2539 |
& $ = $ & $\llbracket \rsimp{(\sum (\map \; (\lambda s. (r \backslash_{rsimps} s) \cdot r^*) \; (\starupdates\;
|
|
593
|
2540 |
cs \; r \; [[c]] )) )} \rrbracket_r $ & (5) \\
|
|
|
2541 |
& $\leq$ & $\llbracket
|
|
|
2542 |
\rdistinct{
|
|
|
2543 |
(\map \;
|
|
620
|
2544 |
(\lambda s. (r \backslash_{rsimps} s) \cdot r^*) \;
|
|
593
|
2545 |
(\starupdates\; cs \; r \; [[c]] )
|
|
|
2546 |
)}
|
|
562
|
2547 |
{\varnothing} \rrbracket_r + 1$ & (6) \\
|
|
|
2548 |
& $\leq$ & $1 + (\textit{card} (\sizeNregex \; (N + n_r)))
|
|
|
2549 |
* (1 + (N + n_r)) $ & (7)\\
|
|
|
2550 |
\end{tabular}
|
|
|
2551 |
\end{center}
|
|
|
2552 |
\noindent
|
|
618
|
2553 |
(5) is by theorem \ref{starClosedForm}.
|
|
562
|
2554 |
(6) is by \ref{altsSimpControl}.
|
|
618
|
2555 |
(7) is by corollary \ref{finiteSizeNCorollary}.
|
|
562
|
2556 |
Combining with the case when $s = []$, one gets
|
|
|
2557 |
\begin{center}
|
|
593
|
2558 |
\begin{tabular}{lcll}
|
|
|
2559 |
$\rsize{r^* \backslash_r s}$ & $\leq$ & $max \; n_r \; 1 + (\textit{card} (\sizeNregex \; (N + n_r)))
|
|
|
2560 |
* (1 + (N + n_r)) $ & (8)\\
|
|
|
2561 |
\end{tabular}
|
|
562
|
2562 |
\end{center}
|
|
|
2563 |
\noindent
|
|
|
2564 |
|
|
|
2565 |
The alternative case is slightly less involved.
|
|
|
2566 |
The inductive hypothesis
|
|
|
2567 |
is equivalent to $\exists N. \forall r \in (\map \; (\_ \backslash_r s) \; rs). \rsize{r} \leq N$.
|
|
|
2568 |
In the case when $s = c::cs$, we have
|
|
|
2569 |
\begin{center}
|
|
593
|
2570 |
\begin{tabular}{lcll}
|
|
562
|
2571 |
& & $ \llbracket \rderssimp{\sum rs }{c::cs} \rrbracket_r $\\
|
|
620
|
2572 |
& $ = $ & $\llbracket \rsimp{(\sum (\map \; (\_ \backslash_{rsimps} s) \; rs) )} \rrbracket_r $ & (9) \\
|
|
|
2573 |
& $\leq$ & $\llbracket (\sum (\map \; (\_ \backslash_{rsimps} s) \; rs) ) \rrbracket_r $ & (10) \\
|
|
562
|
2574 |
& $\leq$ & $1 + N * (length \; rs) $ & (11)\\
|
|
593
|
2575 |
\end{tabular}
|
|
562
|
2576 |
\end{center}
|
|
|
2577 |
\noindent
|
|
618
|
2578 |
(9) is by theorem \ref{altsClosedForm}, (10) by lemma \ref{rsimpMono} and (11) by inductive hypothesis.
|
|
562
|
2579 |
|
|
|
2580 |
Combining with the case when $s = []$, one gets
|
|
|
2581 |
\begin{center}
|
|
593
|
2582 |
\begin{tabular}{lcll}
|
|
|
2583 |
$\rsize{\sum rs \backslash_r s}$ & $\leq$ & $max \; \rsize{\sum rs} \; 1+N*(length \; rs)$
|
|
|
2584 |
& (12)\\
|
|
|
2585 |
\end{tabular}
|
|
562
|
2586 |
\end{center}
|
|
618
|
2587 |
We have all the inductive cases proven.
|
|
558
|
2588 |
\end{proof}
|
|
|
2589 |
|
|
618
|
2590 |
This leads to our main result on the size bound:
|
|
564
|
2591 |
\begin{corollary}
|
|
618
|
2592 |
For any annotated regular expression $a$, $\exists N_r. \forall s. \; \rsize{\bderssimp{a}{s}} \leq N_r$
|
|
564
|
2593 |
\end{corollary}
|
|
|
2594 |
\begin{proof}
|
|
618
|
2595 |
By lemma \ref{sizeRelations} and theorem \ref{rBound}.
|
|
564
|
2596 |
\end{proof}
|
|
558
|
2597 |
\noindent
|
|
|
2598 |
|
|
609
|
2599 |
|
|
|
2600 |
|
|
|
2601 |
|
|
|
2602 |
|
|
558
|
2603 |
%-----------------------------------
|
|
|
2604 |
% SECTION 2
|
|
|
2605 |
%-----------------------------------
|
|
|
2606 |
|
|
625
|
2607 |
\section{Bounded Repetitions}
|
|
|
2608 |
We have promised in chapter \ref{Introduction}
|
|
|
2609 |
that our lexing algorithm can potentially be extended
|
|
|
2610 |
to handle bounded repetitions
|
|
|
2611 |
in natural and elegant ways.
|
|
|
2612 |
Now we fulfill our promise by adding support for
|
|
|
2613 |
the ``exactly-$n$-times'' bounded regular expression $r^{\{n\}}$.
|
|
|
2614 |
We add clauses in our derivatives-based lexing algorithms (with simplifications)
|
|
|
2615 |
introduced in chapter \ref{Bitcoded2}.
|
|
|
2616 |
|
|
|
2617 |
\subsection{Augmented Definitions}
|
|
|
2618 |
There are a number of definitions that need to be augmented.
|
|
|
2619 |
The most notable one would be the POSIX rules for $r^{\{n\}}$:
|
|
|
2620 |
\begin{center}
|
|
|
2621 |
\begin{mathpar}
|
|
|
2622 |
\inferrule{\forall v \in vs_1. \vdash v:r \land
|
|
|
2623 |
|v| \neq []\\ \forall v \in vs_2. \vdash v:r \land |v| = []\\
|
|
|
2624 |
\textit{length} \; (vs_1 @ vs_2) = n}{\textit{Stars} \;
|
|
|
2625 |
(vs_1 @ vs_2) : r^{\{n\}} }
|
|
|
2626 |
\end{mathpar}
|
|
|
2627 |
\end{center}
|
|
|
2628 |
As Ausaf had pointed out \cite{Ausaf},
|
|
|
2629 |
sometimes empty iterations have to be taken to get
|
|
|
2630 |
a match with exactly $n$ repetitions,
|
|
|
2631 |
and hence the $vs_2$ part.
|
|
|
2632 |
|
|
|
2633 |
Another important definition would be the size:
|
|
|
2634 |
\begin{center}
|
|
|
2635 |
\begin{tabular}{lcl}
|
|
|
2636 |
$\llbracket r^{\{n\}} \rrbracket_r$ & $\dn$ &
|
|
|
2637 |
$\llbracket r \rrbracket_r + n$\\
|
|
|
2638 |
\end{tabular}
|
|
|
2639 |
\end{center}
|
|
|
2640 |
\noindent
|
|
|
2641 |
Arguably we should use $\log \; n$ for the size because
|
|
|
2642 |
the number of digits increase logarithmically w.r.t $n$.
|
|
|
2643 |
For simplicity we choose to add the counter directly to the size.
|
|
|
2644 |
|
|
|
2645 |
The derivative w.r.t a bounded regular expression
|
|
|
2646 |
is given as
|
|
|
2647 |
\begin{center}
|
|
|
2648 |
\begin{tabular}{lcl}
|
|
|
2649 |
$r^{\{n\}} \backslash_r c$ & $\dn$ &
|
|
|
2650 |
$r\backslash_r c \cdot r^{\{n-1\}} \;\; \textit{if} \; n \geq 1$\\
|
|
|
2651 |
& & $\RZERO \;\quad \quad\quad \quad
|
|
|
2652 |
\textit{otherwise}$\\
|
|
|
2653 |
\end{tabular}
|
|
|
2654 |
\end{center}
|
|
|
2655 |
\noindent
|
|
|
2656 |
For brevity, we sometimes use NTIMES to refer to bounded
|
|
|
2657 |
regular expressions.
|
|
|
2658 |
The $\mkeps$ function clause for NTIMES would be
|
|
|
2659 |
\begin{center}
|
|
|
2660 |
\begin{tabular}{lcl}
|
|
|
2661 |
$\mkeps \; r^{\{n\}} $ & $\dn$ & $\Stars \;
|
|
|
2662 |
(\textit{replicate} \; n\; (\mkeps \; r))$
|
|
|
2663 |
\end{tabular}
|
|
|
2664 |
\end{center}
|
|
|
2665 |
\noindent
|
|
|
2666 |
The injection looks like
|
|
|
2667 |
\begin{center}
|
|
|
2668 |
\begin{tabular}{lcl}
|
|
|
2669 |
$\inj \; r^{\{n\}} \; c\; (\Seq \;v \; (\Stars \; vs)) $ &
|
|
|
2670 |
$\dn$ & $\Stars \;
|
|
|
2671 |
((\inj \; r \;c \;v ) :: vs)$
|
|
|
2672 |
\end{tabular}
|
|
|
2673 |
\end{center}
|
|
|
2674 |
\noindent
|
|
|
2675 |
|
|
|
2676 |
|
|
|
2677 |
\subsection{Proofs for the Augmented Lexing Algorithm}
|
|
|
2678 |
We need to maintain two proofs with the additional $r^{\{n\}}$
|
|
|
2679 |
construct: the
|
|
|
2680 |
correctness proof in chapter \ref{Bitcoded2},
|
|
|
2681 |
and the finiteness proof in chapter \ref{Finite}.
|
|
|
2682 |
|
|
|
2683 |
\subsubsection{Correctness Proof Augmentation}
|
|
|
2684 |
The correctness of $\textit{lexer}$ and $\textit{blexer}$ with bounded repetitions
|
|
|
2685 |
have been proven by Ausaf and Urban\cite{AusafDyckhoffUrban2016}.
|
|
|
2686 |
As they have commented, once the definitions are in place,
|
|
|
2687 |
the proofs given for the basic regular expressions will extend to
|
|
|
2688 |
bounded regular expressions, and there are no ``surprises''.
|
|
|
2689 |
We confirm this point because the correctness theorem would also
|
|
|
2690 |
extend without surprise to $\blexersimp$.
|
|
|
2691 |
The rewrite rules such as $\rightsquigarrow$, $\stackrel{s}{\rightsquigarrow}$ and so on
|
|
|
2692 |
do not need to be changed,
|
|
|
2693 |
and only a few lemmas such as lemma \ref{fltsPreserves} need to be adjusted to
|
|
|
2694 |
add one more line which can be solved by sledgehammer
|
|
|
2695 |
to solve the $r^{\{n\}}$ inductive case.
|
|
|
2696 |
|
|
|
2697 |
|
|
|
2698 |
\subsubsection{Finiteness Proof Augmentation}
|
|
|
2699 |
The bounded repetitions are
|
|
|
2700 |
very similar to stars, and therefore the treatment
|
|
|
2701 |
is similar, with minor changes to handle some slight complications
|
|
|
2702 |
when the counter reaches 0.
|
|
|
2703 |
The exponential growth is similar:
|
|
|
2704 |
\begin{center}
|
|
|
2705 |
\begin{tabular}{ll}
|
|
|
2706 |
$r^{\{n\}} $ & $\longrightarrow_{\backslash c}$\\
|
|
|
2707 |
$(r\backslash c) \cdot
|
|
|
2708 |
r^{\{n - 1\}}*$ & $\longrightarrow_{\backslash c'}$\\
|
|
|
2709 |
\\
|
|
|
2710 |
$r \backslash cc' \cdot r^{\{n - 2\}}* +
|
|
|
2711 |
r \backslash c' \cdot r^{\{n - 1\}}*$ &
|
|
|
2712 |
$\longrightarrow_{\backslash c''}$\\
|
|
|
2713 |
\\
|
|
|
2714 |
$(r_1 \backslash cc'c'' \cdot r^{\{n-3\}}* +
|
|
|
2715 |
r \backslash c''\cdot r^{\{n-1\}}) +
|
|
|
2716 |
(r \backslash c'c'' \cdot r^{\{n-2\}}* +
|
|
|
2717 |
r \backslash c'' \cdot r^{\{n-1\}}*)$ &
|
|
|
2718 |
$\longrightarrow_{\backslash c'''}$ \\
|
|
|
2719 |
\\
|
|
|
2720 |
$\ldots$\\
|
|
|
2721 |
\end{tabular}
|
|
|
2722 |
\end{center}
|
|
|
2723 |
Again, we assume that $r\backslash c$, $r \backslash cc'$ and so on
|
|
|
2724 |
are all nullable.
|
|
|
2725 |
The flattened list of terms for $r^{\{n\}} \backslash_{rs} s$
|
|
|
2726 |
\begin{center}
|
|
|
2727 |
$[r_1 \backslash cc'c'' \cdot r^{\{n-3\}}*,\;
|
|
|
2728 |
r \backslash c''\cdot r^{\{n-1\}}, \;
|
|
|
2729 |
r \backslash c'c'' \cdot r^{\{n-2\}}*, \;
|
|
|
2730 |
r \backslash c'' \cdot r^{\{n-1\}}*,\; \ldots ]$
|
|
|
2731 |
\end{center}
|
|
|
2732 |
that comes from
|
|
|
2733 |
\begin{center}
|
|
|
2734 |
$(r_1 \backslash cc'c'' \cdot r^{\{n-3\}}* +
|
|
|
2735 |
r \backslash c''\cdot r^{\{n-1\}}) +
|
|
|
2736 |
(r \backslash c'c'' \cdot r^{\{n-2\}}* +
|
|
|
2737 |
r \backslash c'' \cdot r^{\{n-1\}}*)+ \ldots$
|
|
|
2738 |
\end{center}
|
|
|
2739 |
are made of sequences with different tails, where the counters
|
|
|
2740 |
might differ.
|
|
|
2741 |
The observation for maintaining the bound is that
|
|
|
2742 |
these counters never exceed $n$, the original
|
|
|
2743 |
counter. With the number of counters staying finite,
|
|
|
2744 |
$\rDistinct$ will deduplicate and keep the list finite.
|
|
|
2745 |
We introduce this idea as a lemma once we describe all
|
|
|
2746 |
the necessary helper functions.
|
|
|
2747 |
|
|
|
2748 |
Similar to the star case, we want
|
|
|
2749 |
\begin{center}
|
|
|
2750 |
$\rderssimp{r^{\{n\}}}{s} = \rsimp{\sum rs}$.
|
|
|
2751 |
\end{center}
|
|
|
2752 |
where $rs$
|
|
|
2753 |
shall be in the form of
|
|
|
2754 |
$\map \; f \; Ss$, where $f$ is a function and
|
|
|
2755 |
$Ss$ a list of objects to act on.
|
|
|
2756 |
For star, the object's datatype is string.
|
|
|
2757 |
The list of strings $Ss$
|
|
|
2758 |
is generated using functions
|
|
|
2759 |
$\starupdate$ and $\starupdates$.
|
|
|
2760 |
The function that takes a string and returns a regular expression
|
|
|
2761 |
is the anonymous function $
|
|
|
2762 |
(\lambda s'. \; r\backslash s' \cdot r^{\{m\}})$.
|
|
|
2763 |
In the NTIMES setting,
|
|
|
2764 |
the $\starupdate$ and $\starupdates$ functions are replaced by
|
|
|
2765 |
$\textit{nupdate}$ and $\textit{nupdates}$:
|
|
|
2766 |
\begin{center}
|
|
|
2767 |
\begin{tabular}{lcl}
|
|
|
2768 |
$\nupdate \; c \; r \; [] $ & $\dn$ & $[]$\\
|
|
|
2769 |
$\nupdate \; c \; r \;
|
|
|
2770 |
(\Some \; (s, \; n + 1) \; :: \; Ss)$ & $\dn$ & %\\
|
|
|
2771 |
$\textit{if} \;
|
|
|
2772 |
(\rnullable \; (r \backslash_{rs} s))$ \\
|
|
|
2773 |
& & $\;\;\textit{then}
|
|
|
2774 |
\;\; \Some \; (s @ [c], n + 1) :: \Some \; ([c], n) :: (
|
|
|
2775 |
\nupdate \; c \; r \; Ss)$ \\
|
|
|
2776 |
& & $\textit{else} \;\; \Some \; (s @ [c], n+1) :: (
|
|
|
2777 |
\nupdate \; c \; r \; Ss)$\\
|
|
|
2778 |
$\nupdate \; c \; r \; (\textit{None} :: Ss)$ & $\dn$ &
|
|
|
2779 |
$(\None :: \nupdate \; c \; r \; Ss)$\\
|
|
|
2780 |
& & \\
|
|
|
2781 |
%\end{tabular}
|
|
|
2782 |
%\end{center}
|
|
|
2783 |
%\begin{center}
|
|
|
2784 |
%\begin{tabular}{lcl}
|
|
|
2785 |
$\nupdates \; [] \; r \; Ss$ & $\dn$ & $Ss$\\
|
|
|
2786 |
$\nupdates \; (c :: cs) \; r \; Ss$ & $\dn$ & $\nupdates \; cs \; r \; (
|
|
|
2787 |
\nupdate \; c \; r \; Ss)$
|
|
|
2788 |
\end{tabular}
|
|
|
2789 |
\end{center}
|
|
|
2790 |
\noindent
|
|
|
2791 |
which take into account when a subterm
|
|
|
2792 |
\begin{center}
|
|
|
2793 |
$r \backslash_s s \cdot r^{\{n\}}$
|
|
|
2794 |
\end{center}
|
|
|
2795 |
counter $n$
|
|
|
2796 |
is 0, and therefore expands to
|
|
|
2797 |
\begin{center}
|
|
|
2798 |
$r \backslash_s (s@[c]) \cdot r^{\{n\}} \;+
|
|
|
2799 |
\; \ZERO$
|
|
|
2800 |
\end{center}
|
|
|
2801 |
after taking a derivative.
|
|
|
2802 |
The object now has type
|
|
|
2803 |
\begin{center}
|
|
|
2804 |
$\textit{option} \;(\textit{string}, \textit{nat})$
|
|
|
2805 |
\end{center}
|
|
|
2806 |
and therefore the function for converting such an option into
|
|
|
2807 |
a regular expression term is called $\opterm$:
|
|
|
2808 |
|
|
|
2809 |
\begin{center}
|
|
|
2810 |
\begin{tabular}{lcl}
|
|
|
2811 |
$\opterm \; r \; SN$ & $\dn$ & $\textit{case} \; SN\; of$\\
|
|
|
2812 |
& & $\;\;\Some \; (s, n) \Rightarrow
|
|
|
2813 |
(r\backslash_{rs} s)\cdot r^{\{n\}}$\\
|
|
|
2814 |
& & $\;\;\None \Rightarrow
|
|
|
2815 |
\ZERO$\\
|
|
|
2816 |
\end{tabular}
|
|
|
2817 |
\end{center}
|
|
|
2818 |
\noindent
|
|
|
2819 |
Put together, the list $\map \; f \; Ss$ is instantiated as
|
|
|
2820 |
\begin{center}
|
|
|
2821 |
$\map \; (\opterm \; r) \; (\nupdates \; s \; r \;
|
|
|
2822 |
[\Some \; ([c], n)])$.
|
|
|
2823 |
\end{center}
|
|
|
2824 |
For the closed form to be bounded, we would like
|
|
|
2825 |
simplification to be applied to each term in the list.
|
|
|
2826 |
Therefore we introduce some variants of $\opterm$,
|
|
|
2827 |
which help conveniently express the rewriting steps
|
|
|
2828 |
needed in the closed form proof.
|
|
|
2829 |
\begin{center}
|
|
|
2830 |
\begin{tabular}{lcl}
|
|
|
2831 |
$\optermOsimp \; r \; SN$ & $\dn$ & $\textit{case} \; SN\; of$\\
|
|
|
2832 |
& & $\;\;\Some \; (s, n) \Rightarrow
|
|
|
2833 |
\textit{rsimp} \; ((r\backslash_{rs} s)\cdot r^{\{n\}})$\\
|
|
|
2834 |
& & $\;\;\None \Rightarrow
|
|
|
2835 |
\ZERO$\\
|
|
|
2836 |
\\
|
|
|
2837 |
$\optermosimp \; r \; SN$ & $\dn$ & $\textit{case} \; SN\; of$\\
|
|
|
2838 |
& & $\;\;\Some \; (s, n) \Rightarrow
|
|
|
2839 |
(\textit{rsimp} \; (r\backslash_{rs} s))
|
|
|
2840 |
\cdot r^{\{n\}}$\\
|
|
|
2841 |
& & $\;\;\None \Rightarrow
|
|
|
2842 |
\ZERO$\\
|
|
|
2843 |
\\
|
|
|
2844 |
$\optermsimp \; r \; SN$ & $\dn$ & $\textit{case} \; SN\; of$\\
|
|
|
2845 |
& & $\;\;\Some \; (s, n) \Rightarrow
|
|
|
2846 |
(r\backslash_{rsimps} s)\cdot r^{\{n\}}$\\
|
|
|
2847 |
& & $\;\;\None \Rightarrow
|
|
|
2848 |
\ZERO$\\
|
|
|
2849 |
\end{tabular}
|
|
|
2850 |
\end{center}
|
|
|
2851 |
|
|
|
2852 |
|
|
|
2853 |
For a list of
|
|
|
2854 |
$\textit{option} \;(\textit{string}, \textit{nat})$ elements,
|
|
|
2855 |
we define the highest power for it recursively:
|
|
|
2856 |
\begin{center}
|
|
|
2857 |
\begin{tabular}{lcl}
|
|
|
2858 |
$\hpa \; [] \; n $ & $\dn$ & $n$\\
|
|
|
2859 |
$\hpa \; (\None :: os) \; n $ & $\dn$ & $\hpa \; os \; n$\\
|
|
|
2860 |
$\hpa \; (\Some \; (s, n) :: os) \; m$ & $\dn$ &
|
|
|
2861 |
$\hpa \;os \; (\textit{max} \; n\; m)$\\
|
|
|
2862 |
\\
|
|
|
2863 |
$\hpower \; rs $ & $\dn$ & $\hpa \; rs \; 0$\\
|
|
|
2864 |
\end{tabular}
|
|
|
2865 |
\end{center}
|
|
|
2866 |
|
|
|
2867 |
Now the intuition that an NTIMES regular expression's power
|
|
|
2868 |
does not increase can be easily expressed as
|
|
|
2869 |
\begin{lemma}\label{nupdatesMono2}
|
|
|
2870 |
$\hpower \; (\nupdates \;s \; r \; [\Some \; ([c], n)]) \leq n$
|
|
|
2871 |
\end{lemma}
|
|
|
2872 |
\begin{proof}
|
|
|
2873 |
Note that the power is non-increasing after a $\nupdate$ application:
|
|
|
2874 |
\begin{center}
|
|
|
2875 |
$\hpa \;\; (\nupdate \; c \; r \; Ss)\;\; m \leq
|
|
|
2876 |
\hpa\; \; Ss \; m$.
|
|
|
2877 |
\end{center}
|
|
|
2878 |
This is also the case for $\nupdates$:
|
|
|
2879 |
\begin{center}
|
|
|
2880 |
$\hpa \;\; (\nupdates \; s \; r \; Ss)\;\; m \leq
|
|
|
2881 |
\hpa\; \; Ss \; m$.
|
|
|
2882 |
\end{center}
|
|
|
2883 |
Therefore we have that
|
|
|
2884 |
\begin{center}
|
|
|
2885 |
$\hpower \;\; (\nupdates \; s \; r \; Ss) \leq
|
|
|
2886 |
\hpower \;\; Ss$
|
|
|
2887 |
\end{center}
|
|
|
2888 |
which leads to the lemma being proven.
|
|
|
2889 |
|
|
|
2890 |
\end{proof}
|
|
|
2891 |
|
|
|
2892 |
|
|
|
2893 |
We also define the inductive rules for
|
|
|
2894 |
the shape of derivatives of the NTIMES regular expressions:\\[-3em]
|
|
|
2895 |
\begin{center}
|
|
|
2896 |
\begin{mathpar}
|
|
|
2897 |
\inferrule{\mbox{}}{\cbn \;\ZERO}
|
|
|
2898 |
|
|
|
2899 |
\inferrule{\mbox{}}{\cbn \; \; r_a \cdot (r^{\{n\}})}
|
|
|
2900 |
|
|
|
2901 |
\inferrule{\cbn \; r_1 \;\; \; \cbn \; r_2}{\cbn \; r_1 + r_2}
|
|
|
2902 |
|
|
|
2903 |
\inferrule{\cbn \; r}{\cbn \; r + \ZERO}
|
|
|
2904 |
\end{mathpar}
|
|
|
2905 |
\end{center}
|
|
|
2906 |
\noindent
|
|
|
2907 |
A derivative of NTIMES fits into the shape described by $\cbn$:
|
|
|
2908 |
\begin{lemma}\label{ntimesDersCbn}
|
|
|
2909 |
$\cbn \; ((r' \cdot r^{\{n\}}) \backslash_{rs} s)$ holds.
|
|
|
2910 |
\end{lemma}
|
|
|
2911 |
\begin{proof}
|
|
|
2912 |
By a reverse induction on $s$.
|
|
|
2913 |
For the inductive case, note that if $\cbn \; r$ holds,
|
|
|
2914 |
then $\cbn \; (r\backslash_r c)$ holds.
|
|
|
2915 |
\end{proof}
|
|
|
2916 |
\noindent
|
|
|
2917 |
In addition, for $\cbn$-shaped regular expressioins, one can flatten
|
|
|
2918 |
them:
|
|
|
2919 |
\begin{lemma}\label{ntimesHfauPushin}
|
|
|
2920 |
If $\cbn \; r$ holds, then $\hflataux{r \backslash_r c} =
|
|
|
2921 |
\textit{concat} \; (\map \; \hflataux{\map \; (\_\backslash_r c) \;
|
|
|
2922 |
(\hflataux{r})})$
|
|
|
2923 |
\end{lemma}
|
|
|
2924 |
\begin{proof}
|
|
|
2925 |
By an induction on the inductive cases of $\cbn$.
|
|
|
2926 |
\end{proof}
|
|
|
2927 |
\noindent
|
|
|
2928 |
This time we do not need to define the flattening functions for NTIMES only,
|
|
|
2929 |
because $\hflat{\_}$ and $\hflataux{\_}$ work on NTIMES already.
|
|
|
2930 |
\begin{lemma}\label{ntimesHfauInduct}
|
|
|
2931 |
$\hflataux{( (r\backslash_r c) \cdot r^{\{n\}}) \backslash_{rsimps} s} =
|
|
|
2932 |
\map \; (\opterm \; r) \; (\nupdates \; s \; r \; [\Some \; ([c], n)])$
|
|
|
2933 |
\end{lemma}
|
|
|
2934 |
\begin{proof}
|
|
|
2935 |
By a reverse induction on $s$.
|
|
|
2936 |
The lemmas \ref{ntimesHfauPushin} and \ref{ntimesDersCbn} are used.
|
|
|
2937 |
\end{proof}
|
|
|
2938 |
\noindent
|
|
|
2939 |
We have a recursive property for NTIMES with $\nupdate$
|
|
|
2940 |
similar to that for STAR,
|
|
|
2941 |
and one for $\nupdates $ as well:
|
|
|
2942 |
\begin{lemma}\label{nupdateInduct1}
|
|
|
2943 |
\mbox{}
|
|
|
2944 |
\begin{itemize}
|
|
|
2945 |
\item
|
|
|
2946 |
\begin{center}
|
|
|
2947 |
$\textit{concat} \; (\map \; (\hflataux{\_} \circ (
|
|
|
2948 |
\opterm \; r)) \; Ss) = \map \; (\opterm \; r) \; (\nupdate \;
|
|
|
2949 |
c \; r \; Ss)$\\
|
|
|
2950 |
\end{center}
|
|
|
2951 |
holds.
|
|
|
2952 |
\item
|
|
|
2953 |
\begin{center}
|
|
|
2954 |
$\textit{concat} \; (\map \; \hflataux{\_}\;
|
|
|
2955 |
\map \; (\_\backslash_r x) \;
|
|
|
2956 |
(\map \; (\opterm \; r) \; (\nupdates \; xs \; r \; Ss)))$\\
|
|
|
2957 |
$=$\\
|
|
|
2958 |
$\map \; (\opterm \; r) \; (\nupdates \;(xs@[x]) \; r\;Ss)$
|
|
|
2959 |
\end{center}
|
|
|
2960 |
holds.
|
|
|
2961 |
\end{itemize}
|
|
|
2962 |
\end{lemma}
|
|
|
2963 |
\begin{proof}
|
|
|
2964 |
(i) is by an induction on $Ss$.
|
|
|
2965 |
(ii) is by an induction on $xs$.
|
|
|
2966 |
\end{proof}
|
|
|
2967 |
\noindent
|
|
|
2968 |
The $\nString$ predicate is defined for conveniently
|
|
|
2969 |
expressing that there are no empty strings in the
|
|
|
2970 |
$\Some \;(s, n)$ elements generated by $\nupdate$:
|
|
|
2971 |
\begin{center}
|
|
|
2972 |
\begin{tabular}{lcl}
|
|
|
2973 |
$\nString \; \None$ & $\dn$ & $ \textit{true}$\\
|
|
|
2974 |
$\nString \; (\Some \; ([], n))$ & $\dn$ & $ \textit{false}$\\
|
|
|
2975 |
$\nString \; (\Some \; (c::s, n))$ & $\dn$ & $ \textit{true}$\\
|
|
|
2976 |
\end{tabular}
|
|
|
2977 |
\end{center}
|
|
|
2978 |
\begin{lemma}\label{nupdatesNonempty}
|
|
|
2979 |
If for all elements $o \in \textit{set} \; Ss$,
|
|
|
2980 |
$\nString \; o$ holds, the we have that
|
|
|
2981 |
for all elements $o' \in \textit{set} \; (\nupdates \; s \; r \; Ss)$,
|
|
|
2982 |
$\nString \; o'$ holds.
|
|
|
2983 |
\end{lemma}
|
|
|
2984 |
\begin{proof}
|
|
|
2985 |
By an induction on $s$, where $Ss$ is set to vary over all possible values.
|
|
|
2986 |
\end{proof}
|
|
|
2987 |
|
|
|
2988 |
\noindent
|
|
|
2989 |
|
|
|
2990 |
\begin{lemma}\label{ntimesClosedFormsSteps}
|
|
|
2991 |
The following list of equalities or rewriting relations hold:\\
|
|
|
2992 |
(i) $r^{\{n+1\}} \backslash_{rsimps} (c::s) =
|
|
|
2993 |
\textit{rsimp} \; (\sum (\map \; (\opterm \;r \;\_) \; (\nupdates \;
|
|
|
2994 |
s \; r \; [\Some \; ([c], n)])))$\\
|
|
|
2995 |
(ii)
|
|
|
2996 |
\begin{center}
|
|
|
2997 |
$\sum (\map \; (\opterm \; r) \; (\nupdates \; s \; r \; [
|
|
|
2998 |
\Some \; ([c], n)]))$ \\ $ \sequal$\\
|
|
|
2999 |
$\sum (\map \; (\textit{rsimp} \circ (\opterm \; r))\; (\nupdates \;
|
|
|
3000 |
s\;r \; [\Some \; ([c], n)]))$\\
|
|
|
3001 |
\end{center}
|
|
|
3002 |
(iii)
|
|
|
3003 |
\begin{center}
|
|
|
3004 |
$\sum \;(\map \; (\optermosimp \; r) \; (\nupdates \; s \; r\; [\Some \;
|
|
|
3005 |
([c], n)]))$\\
|
|
|
3006 |
$\sequal$\\
|
|
|
3007 |
$\sum \;(\map \; (\optermsimp r) \; (\nupdates \; s \; r \; [\Some \;
|
|
|
3008 |
([c], n)])) $\\
|
|
|
3009 |
\end{center}
|
|
|
3010 |
(iv)
|
|
|
3011 |
\begin{center}
|
|
|
3012 |
$\sum \;(\map \; (\optermosimp \; r) \; (\nupdates \; s \; r\; [\Some \;
|
|
|
3013 |
([c], n)])) $ \\ $\sequal$\\
|
|
|
3014 |
$\sum \;(\map \; (\optermOsimp r) \; (\nupdates \; s \; r \; [\Some \;
|
|
|
3015 |
([c], n)])) $\\
|
|
|
3016 |
\end{center}
|
|
|
3017 |
(v)
|
|
|
3018 |
\begin{center}
|
|
|
3019 |
$\sum \;(\map \; (\optermOsimp r) \; (\nupdates \; s \; r \; [\Some \;
|
|
|
3020 |
([c], n)])) $ \\ $\sequal$\\
|
|
|
3021 |
$\sum \; (\map \; (\textit{rsimp} \circ (\opterm \; r)) \;
|
|
|
3022 |
(\nupdates \; s \; r \; [\Some \; ([c], n)]))$
|
|
|
3023 |
\end{center}
|
|
|
3024 |
\end{lemma}
|
|
|
3025 |
\begin{proof}
|
|
|
3026 |
Routine.
|
|
|
3027 |
(iii) and (iv) make use of the fact that all the strings $s$
|
|
|
3028 |
inside $\Some \; (s, m)$ which are elements of the list
|
|
|
3029 |
$\nupdates \; s\;r\;[\Some\; ([c], n)]$ are non-empty,
|
|
|
3030 |
which is from lemma \ref{nupdatesNonempty}.
|
|
|
3031 |
Once the string in $o = \Some \; (s, n)$ is
|
|
|
3032 |
nonempty, $\optermsimp \; r \;o$,
|
|
|
3033 |
$\optermosimp \; r \; o$ and $\optermosimp \; \; o$ are guaranteed
|
|
|
3034 |
to be equal.
|
|
|
3035 |
(v) uses \ref{nupdateInduct1}.
|
|
|
3036 |
\end{proof}
|
|
|
3037 |
\noindent
|
|
|
3038 |
Now we are ready to present the closed form for NTIMES:
|
|
|
3039 |
\begin{theorem}\label{ntimesClosedForm}
|
|
|
3040 |
The derivative of $r^{\{n+1\}}$ can be described as an alternative
|
|
|
3041 |
containing a list
|
|
|
3042 |
of terms:\\
|
|
|
3043 |
$r^{\{n+1\}} \backslash_{rsimps} (c::s) = \textit{rsimp} \; (
|
|
|
3044 |
\sum (\map \; (\optermsimp \; r) \; (\nupdates \; s \; r \;
|
|
|
3045 |
[\Some \; ([c], n)])))$
|
|
|
3046 |
\end{theorem}
|
|
|
3047 |
\begin{proof}
|
|
|
3048 |
By the rewriting steps described in lemma \ref{ntimesClosedFormsSteps}.
|
|
|
3049 |
\end{proof}
|
|
|
3050 |
\noindent
|
|
|
3051 |
The key observation for bounding this closed form
|
|
|
3052 |
is that the counter on $r^{\{n\}}$ will
|
|
|
3053 |
only decrement during derivatives:
|
|
|
3054 |
\begin{lemma}\label{nupdatesNLeqN}
|
|
|
3055 |
For an element $o$ in $\textit{set} \; (\nupdates \; s \; r \;
|
|
|
3056 |
[\Some \; ([c], n)])$, either $o = \None$, or $o = \Some
|
|
|
3057 |
\; (s', m)$ for some string $s'$ and number $m \leq n$.
|
|
|
3058 |
\end{lemma}
|
|
|
3059 |
\noindent
|
|
|
3060 |
The proof is routine and therefore omitted.
|
|
|
3061 |
This allows us to say what kind of terms
|
|
|
3062 |
are in the list $\textit{set} \; (\map \; (\optermsimp \; r) \; (
|
|
|
3063 |
\nupdates \; s \; r \; [\Some \; ([c], n)]))$:
|
|
|
3064 |
only $\ZERO_r$s or a sequence with the tail an $r^{\{m\}}$
|
|
|
3065 |
with a small $m$:
|
|
|
3066 |
\begin{lemma}\label{ntimesClosedFormListElemShape}
|
|
|
3067 |
For any element $r'$ in $\textit{set} \; (\map \; (\optermsimp \; r) \; (
|
|
|
3068 |
\nupdates \; s \; r \; [\Some \; ([c], n)]))$,
|
|
|
3069 |
we have that $r'$ is either $\ZERO$ or $r \backslash_{rsimps} s' \cdot
|
|
|
3070 |
r^{\{m\}}$ for some string $s'$ and number $m \leq n$.
|
|
|
3071 |
\end{lemma}
|
|
|
3072 |
\begin{proof}
|
|
|
3073 |
Using lemma \ref{nupdatesNLeqN}.
|
|
|
3074 |
\end{proof}
|
|
|
3075 |
|
|
|
3076 |
\begin{theorem}\label{ntimesClosedFormBounded}
|
|
|
3077 |
Assuming that for any string $s$, $\llbracket r \backslash_{rsimps} s
|
|
|
3078 |
\rrbracket_r \leq N$ holds, then we have that\\
|
|
|
3079 |
$\llbracket r^{\{n+1\}} \backslash_{rsimps} s \rrbracket_r \leq
|
|
|
3080 |
\textit{max} \; (c_N+1)* (N + \llbracket r^{\{n\}} \rrbracket+1)$,
|
|
|
3081 |
where $c_N = \textit{card} \; (\textit{sizeNregex} \; (
|
|
|
3082 |
N + \llbracket r^{\{n\}} \rrbracket_r+1))$.
|
|
|
3083 |
\end{theorem}
|
|
|
3084 |
\begin{proof}
|
|
|
3085 |
We have that for all regular expressions $r'$ in $\textit{set} \; (\map \; (\optermsimp \; r) \; (
|
|
|
3086 |
\nupdates \; s \; r \; [\Some \; ([c], n)]))$,
|
|
|
3087 |
$r'$'s size is less than or equal to $N + \llbracket r^{\{n\}}
|
|
|
3088 |
\rrbracket_r + 1$
|
|
|
3089 |
because $r'$ can only be either a $\ZERO$ or $r \backslash_{rsimps} s' \cdot
|
|
|
3090 |
r^{\{m\}}$ for some string $s'$ and number
|
|
|
3091 |
$m \leq n$ (lemma \ref{ntimesClosedFormListElemShape}).
|
|
|
3092 |
In addition, we know that the list
|
|
|
3093 |
$\map \; (\optermsimp \; r) \; (
|
|
|
3094 |
\nupdates \; s \; r \; [\Some \; ([c], n)])$'s size is at most
|
|
|
3095 |
$c_N = \textit{card} \;
|
|
|
3096 |
(\sizeNregex \; ((N + \llbracket r^{\{n\}} \rrbracket) + 1))$.
|
|
|
3097 |
This gives us $\llbracket r \backslash_{rsimps} \;s \rrbracket_r
|
|
|
3098 |
\leq N * c_N$.
|
|
|
3099 |
\end{proof}
|
|
|
3100 |
|
|
|
3101 |
We aim to formalise the correctness and size bound
|
|
|
3102 |
for constructs like $r^{\{\ldots n\}}$, $r^{\{n \ldots\}}$
|
|
|
3103 |
and so on, which is still work in progress.
|
|
|
3104 |
They should more or less follow the same recipe described in this section.
|
|
|
3105 |
Once we know about how to deal with them recursively using suitable auxiliary
|
|
|
3106 |
definitions, we are able to routinely establish the proofs.
|
|
|
3107 |
|
|
532
|
3108 |
|
|
557
|
3109 |
%----------------------------------------------------------------------------------------
|
|
|
3110 |
% SECTION 3
|
|
|
3111 |
%----------------------------------------------------------------------------------------
|
|
|
3112 |
|
|
532
|
3113 |
|
|
618
|
3114 |
\section{Comments and Future Improvements}
|
|
|
3115 |
\subsection{Some Experimental Results}
|
|
532
|
3116 |
What guarantee does this bound give us?
|
|
|
3117 |
Whatever the regex is, it will not grow indefinitely.
|
|
|
3118 |
Take our previous example $(a + aa)^*$ as an example:
|
|
|
3119 |
\begin{center}
|
|
593
|
3120 |
\begin{tabular}{@{}c@{\hspace{0mm}}c@{\hspace{0mm}}c@{}}
|
|
|
3121 |
\begin{tikzpicture}
|
|
|
3122 |
\begin{axis}[
|
|
|
3123 |
xlabel={number of $a$'s},
|
|
|
3124 |
x label style={at={(1.05,-0.05)}},
|
|
|
3125 |
ylabel={regex size},
|
|
|
3126 |
enlargelimits=false,
|
|
|
3127 |
xtick={0,5,...,30},
|
|
|
3128 |
xmax=33,
|
|
|
3129 |
ymax= 40,
|
|
|
3130 |
ytick={0,10,...,40},
|
|
|
3131 |
scaled ticks=false,
|
|
|
3132 |
axis lines=left,
|
|
|
3133 |
width=5cm,
|
|
|
3134 |
height=4cm,
|
|
|
3135 |
legend entries={$(a + aa)^*$},
|
|
618
|
3136 |
legend pos=south east,
|
|
593
|
3137 |
legend cell align=left]
|
|
|
3138 |
\addplot[red,mark=*, mark options={fill=white}] table {a_aa_star.data};
|
|
|
3139 |
\end{axis}
|
|
|
3140 |
\end{tikzpicture}
|
|
|
3141 |
\end{tabular}
|
|
532
|
3142 |
\end{center}
|
|
|
3143 |
We are able to limit the size of the regex $(a + aa)^*$'s derivatives
|
|
593
|
3144 |
with our simplification
|
|
532
|
3145 |
rules very effectively.
|
|
|
3146 |
|
|
|
3147 |
|
|
|
3148 |
In our proof for the inductive case $r_1 \cdot r_2$, the dominant term in the bound
|
|
|
3149 |
is $l_{N_2} * N_2$, where $N_2$ is the bound we have for $\llbracket \bderssimp{r_2}{s} \rrbracket$.
|
|
|
3150 |
Given that $l_{N_2}$ is roughly the size $4^{N_2}$, the size bound $\llbracket \bderssimp{r_1 \cdot r_2}{s} \rrbracket$
|
|
|
3151 |
inflates the size bound of $\llbracket \bderssimp{r_2}{s} \rrbracket$ with the function
|
|
|
3152 |
$f(x) = x * 2^x$.
|
|
|
3153 |
This means the bound we have will surge up at least
|
|
|
3154 |
tower-exponentially with a linear increase of the depth.
|
|
|
3155 |
|
|
618
|
3156 |
One might be quite skeptical about what this non-elementary
|
|
|
3157 |
bound can bring us.
|
|
|
3158 |
It turns out that the giant bounds are far from being hit.
|
|
|
3159 |
Here we have some test data from randomly generated regular expressions:
|
|
|
3160 |
\begin{figure}[H]
|
|
|
3161 |
\begin{tabular}{@{}c@{\hspace{2mm}}c@{\hspace{0mm}}c@{}}
|
|
593
|
3162 |
\begin{tikzpicture}
|
|
|
3163 |
\begin{axis}[
|
|
618
|
3164 |
xlabel={$n$},
|
|
593
|
3165 |
x label style={at={(1.05,-0.05)}},
|
|
|
3166 |
ylabel={regex size},
|
|
|
3167 |
enlargelimits=false,
|
|
|
3168 |
xtick={0,5,...,30},
|
|
|
3169 |
xmax=33,
|
|
611
|
3170 |
%ymax=1000,
|
|
|
3171 |
%ytick={0,100,...,1000},
|
|
593
|
3172 |
scaled ticks=false,
|
|
|
3173 |
axis lines=left,
|
|
618
|
3174 |
width=4.75cm,
|
|
|
3175 |
height=3.8cm,
|
|
593
|
3176 |
legend entries={regex1},
|
|
618
|
3177 |
legend pos=north east,
|
|
593
|
3178 |
legend cell align=left]
|
|
|
3179 |
\addplot[red,mark=*, mark options={fill=white}] table {regex1_size_change.data};
|
|
|
3180 |
\end{axis}
|
|
|
3181 |
\end{tikzpicture}
|
|
618
|
3182 |
&
|
|
593
|
3183 |
\begin{tikzpicture}
|
|
|
3184 |
\begin{axis}[
|
|
|
3185 |
xlabel={$n$},
|
|
|
3186 |
x label style={at={(1.05,-0.05)}},
|
|
|
3187 |
%ylabel={time in secs},
|
|
|
3188 |
enlargelimits=false,
|
|
|
3189 |
xtick={0,5,...,30},
|
|
|
3190 |
xmax=33,
|
|
611
|
3191 |
%ymax=1000,
|
|
|
3192 |
%ytick={0,100,...,1000},
|
|
593
|
3193 |
scaled ticks=false,
|
|
|
3194 |
axis lines=left,
|
|
618
|
3195 |
width=4.75cm,
|
|
|
3196 |
height=3.8cm,
|
|
593
|
3197 |
legend entries={regex2},
|
|
618
|
3198 |
legend pos=south east,
|
|
593
|
3199 |
legend cell align=left]
|
|
|
3200 |
\addplot[blue,mark=*, mark options={fill=white}] table {regex2_size_change.data};
|
|
|
3201 |
\end{axis}
|
|
|
3202 |
\end{tikzpicture}
|
|
618
|
3203 |
&
|
|
593
|
3204 |
\begin{tikzpicture}
|
|
|
3205 |
\begin{axis}[
|
|
|
3206 |
xlabel={$n$},
|
|
|
3207 |
x label style={at={(1.05,-0.05)}},
|
|
|
3208 |
%ylabel={time in secs},
|
|
|
3209 |
enlargelimits=false,
|
|
|
3210 |
xtick={0,5,...,30},
|
|
|
3211 |
xmax=33,
|
|
611
|
3212 |
%ymax=1000,
|
|
|
3213 |
%ytick={0,100,...,1000},
|
|
593
|
3214 |
scaled ticks=false,
|
|
|
3215 |
axis lines=left,
|
|
618
|
3216 |
width=4.75cm,
|
|
|
3217 |
height=3.8cm,
|
|
593
|
3218 |
legend entries={regex3},
|
|
618
|
3219 |
legend pos=south east,
|
|
593
|
3220 |
legend cell align=left]
|
|
|
3221 |
\addplot[cyan,mark=*, mark options={fill=white}] table {regex3_size_change.data};
|
|
|
3222 |
\end{axis}
|
|
|
3223 |
\end{tikzpicture}\\
|
|
618
|
3224 |
\multicolumn{3}{c}{}
|
|
593
|
3225 |
\end{tabular}
|
|
618
|
3226 |
\caption{Graphs: size change of 3 randomly generated
|
|
|
3227 |
regular expressions $w.r.t.$ input string length.
|
|
|
3228 |
The x axis represents the length of input.}
|
|
611
|
3229 |
\end{figure}
|
|
532
|
3230 |
\noindent
|
|
|
3231 |
Most of the regex's sizes seem to stay within a polynomial bound $w.r.t$ the
|
|
|
3232 |
original size.
|
|
591
|
3233 |
We will discuss improvements to this bound in the next chapter.
|
|
532
|
3234 |
|
|
|
3235 |
|
|
|
3236 |
|
|
618
|
3237 |
\subsection{Possible Further Improvements}
|
|
|
3238 |
There are two problems with this finiteness result, though.\\
|
|
|
3239 |
(i)
|
|
|
3240 |
First, it is not yet a direct formalisation of our lexer's complexity,
|
|
593
|
3241 |
as a complexity proof would require looking into
|
|
|
3242 |
the time it takes to execute {\bf all} the operations
|
|
618
|
3243 |
involved in the lexer (simp, collect, decode), not just the derivative.\\
|
|
|
3244 |
(ii)
|
|
593
|
3245 |
Second, the bound is not yet tight, and we seek to improve $N_a$ so that
|
|
618
|
3246 |
it is polynomial on $\llbracket a \rrbracket$.\\
|
|
|
3247 |
Still, we believe this contribution is useful,
|
|
590
|
3248 |
because
|
|
|
3249 |
\begin{itemize}
|
|
|
3250 |
\item
|
|
|
3251 |
|
|
618
|
3252 |
The size proof can serve as a starting point for a complexity
|
|
590
|
3253 |
formalisation.
|
|
|
3254 |
Derivatives are the most important phases of our lexer algorithm.
|
|
|
3255 |
Size properties about derivatives covers the majority of the algorithm
|
|
|
3256 |
and is therefore a good indication of complexity of the entire program.
|
|
|
3257 |
\item
|
|
|
3258 |
The bound is already a strong indication that catastrophic
|
|
|
3259 |
backtracking is much less likely to occur in our $\blexersimp$
|
|
|
3260 |
algorithm.
|
|
|
3261 |
We refine $\blexersimp$ with $\blexerStrong$ in the next chapter
|
|
|
3262 |
so that the bound becomes polynomial.
|
|
|
3263 |
\end{itemize}
|
|
593
|
3264 |
|
|
532
|
3265 |
%----------------------------------------------------------------------------------------
|
|
|
3266 |
% SECTION 4
|
|
|
3267 |
%----------------------------------------------------------------------------------------
|
|
593
|
3268 |
|
|
|
3269 |
|
|
|
3270 |
|
|
|
3271 |
|
|
|
3272 |
|
|
|
3273 |
|
|
|
3274 |
|
|
|
3275 |
|
|
532
|
3276 |
One might wonder the actual bound rather than the loose bound we gave
|
|
|
3277 |
for the convenience of an easier proof.
|
|
|
3278 |
How much can the regex $r^* \backslash s$ grow?
|
|
|
3279 |
As earlier graphs have shown,
|
|
|
3280 |
%TODO: reference that graph where size grows quickly
|
|
593
|
3281 |
they can grow at a maximum speed
|
|
|
3282 |
exponential $w.r.t$ the number of characters,
|
|
532
|
3283 |
but will eventually level off when the string $s$ is long enough.
|
|
|
3284 |
If they grow to a size exponential $w.r.t$ the original regex, our algorithm
|
|
|
3285 |
would still be slow.
|
|
|
3286 |
And unfortunately, we have concrete examples
|
|
576
|
3287 |
where such regular expressions grew exponentially large before levelling off:
|
|
618
|
3288 |
\begin{center}
|
|
532
|
3289 |
$(a ^ * + (aa) ^ * + (aaa) ^ * + \ldots +
|
|
618
|
3290 |
(\underbrace{a \ldots a}_{\text{n a's}})^*)^*$
|
|
|
3291 |
\end{center}
|
|
|
3292 |
will already have a maximum
|
|
593
|
3293 |
size that is exponential on the number $n$
|
|
532
|
3294 |
under our current simplification rules:
|
|
|
3295 |
%TODO: graph of a regex whose size increases exponentially.
|
|
|
3296 |
\begin{center}
|
|
593
|
3297 |
\begin{tikzpicture}
|
|
|
3298 |
\begin{axis}[
|
|
|
3299 |
height=0.5\textwidth,
|
|
|
3300 |
width=\textwidth,
|
|
|
3301 |
xlabel=number of a's,
|
|
|
3302 |
xtick={0,...,9},
|
|
|
3303 |
ylabel=maximum size,
|
|
|
3304 |
ymode=log,
|
|
|
3305 |
log basis y={2}
|
|
|
3306 |
]
|
|
|
3307 |
\addplot[mark=*,blue] table {re-chengsong.data};
|
|
|
3308 |
\end{axis}
|
|
|
3309 |
\end{tikzpicture}
|
|
532
|
3310 |
\end{center}
|
|
|
3311 |
|
|
618
|
3312 |
For convenience we use $(\sum_{i=1}^{n} (\underbrace{a \ldots a}_{\text{i a's}})^*)^*$
|
|
532
|
3313 |
to express $(a ^ * + (aa) ^ * + (aaa) ^ * + \ldots +
|
|
|
3314 |
(\underbrace{a \ldots a}_{\text{n a's}})^*$ in the below discussion.
|
|
|
3315 |
The exponential size is triggered by that the regex
|
|
618
|
3316 |
$\sum_{i=1}^{n} (\underbrace{a \ldots a}_{\text{i a's}})^*$
|
|
532
|
3317 |
inside the $(\ldots) ^*$ having exponentially many
|
|
|
3318 |
different derivatives, despite those difference being minor.
|
|
618
|
3319 |
$(\sum_{i=1}^{n} (\underbrace{a \ldots a}_{\text{i a's}})^*)^*\backslash \underbrace{a \ldots a}_{\text{m a's}}$
|
|
532
|
3320 |
will therefore contain the following terms (after flattening out all nested
|
|
|
3321 |
alternatives):
|
|
|
3322 |
\begin{center}
|
|
618
|
3323 |
$(\sum_{i = 1}^{n} (\underbrace{a \ldots a}_{\text{((i - (m' \% i))\%i) a's}})\cdot (\underbrace{a \ldots a}_{\text{i a's}})^* )\cdot (\sum_{i=1}^{n} (\underbrace{a \ldots a}_{\text{i a's}})^*)$\\
|
|
|
3324 |
[1mm]
|
|
593
|
3325 |
$(1 \leq m' \leq m )$
|
|
532
|
3326 |
\end{center}
|
|
618
|
3327 |
There at at least exponentially
|
|
|
3328 |
many such terms.\footnote{To be exact, these terms are
|
|
|
3329 |
distinct for $m' \leq L.C.M.(1, \ldots, n)$, the details are omitted,
|
|
|
3330 |
but the point is that the number is exponential.
|
|
|
3331 |
}
|
|
593
|
3332 |
With each new input character taking the derivative against the intermediate result, more and more such distinct
|
|
618
|
3333 |
terms will accumulate.
|
|
|
3334 |
The function $\textit{distinctBy}$ will not be able to de-duplicate any two of these terms
|
|
|
3335 |
\begin{center}
|
|
|
3336 |
$(\sum_{i = 1}^{n}
|
|
|
3337 |
(\underbrace{a \ldots a}_{\text{((i - (m' \% i))\%i) a's}})\cdot
|
|
|
3338 |
(\underbrace{a \ldots a}_{\text{i a's}})^* )\cdot
|
|
|
3339 |
(\sum_{i=1}^{n} (\underbrace{a \ldots a}_{\text{i a's}})^*)^*$\\
|
|
|
3340 |
$(\sum_{i = 1}^{n} (\underbrace{a \ldots a}_{\text{((i - (m'' \% i))\%i) a's}})\cdot
|
|
|
3341 |
(\underbrace{a \ldots a}_{\text{i a's}})^* )\cdot
|
|
|
3342 |
(\sum_{i=1}^{n} (\underbrace{a \ldots a}_{\text{i a's}})^*)^*$
|
|
|
3343 |
\end{center}
|
|
|
3344 |
\noindent
|
|
|
3345 |
where $m' \neq m''$
|
|
593
|
3346 |
as they are slightly different.
|
|
|
3347 |
This means that with our current simplification methods,
|
|
|
3348 |
we will not be able to control the derivative so that
|
|
618
|
3349 |
$\llbracket \bderssimp{r}{s} \rrbracket$ stays polynomial. %\leq O((\llbracket r\rrbacket)^c)$
|
|
593
|
3350 |
These terms are similar in the sense that the head of those terms
|
|
|
3351 |
are all consisted of sub-terms of the form:
|
|
|
3352 |
$(\underbrace{a \ldots a}_{\text{j a's}})\cdot (\underbrace{a \ldots a}_{\text{i a's}})^* $.
|
|
618
|
3353 |
For $\sum_{i=1}^{n} (\underbrace{a \ldots a}_{\text{i a's}})^*$, there will be at most
|
|
593
|
3354 |
$n * (n + 1) / 2$ such terms.
|
|
|
3355 |
For example, $(a^* + (aa)^* + (aaa)^*) ^*$'s derivatives
|
|
|
3356 |
can be described by 6 terms:
|
|
|
3357 |
$a^*$, $a\cdot (aa)^*$, $ (aa)^*$,
|
|
|
3358 |
$aa \cdot (aaa)^*$, $a \cdot (aaa)^*$, and $(aaa)^*$.
|
|
532
|
3359 |
The total number of different "head terms", $n * (n + 1) / 2$,
|
|
593
|
3360 |
is proportional to the number of characters in the regex
|
|
618
|
3361 |
$(\sum_{i=1}^{n} (\underbrace{a \ldots a}_{\text{i a's}})^*)^*$.
|
|
|
3362 |
If we can improve our deduplication process so that it becomes smarter
|
|
|
3363 |
and only keep track of these $n * (n+1) /2$ terms, then we can keep
|
|
|
3364 |
the size growth polynomial again.
|
|
|
3365 |
This example also suggests a slightly different notion of size, which we call the
|
|
532
|
3366 |
alphabetic width:
|
|
618
|
3367 |
\begin{center}
|
|
|
3368 |
\begin{tabular}{lcl}
|
|
|
3369 |
$\textit{awidth} \; \ZERO$ & $\dn$ & $0$\\
|
|
|
3370 |
$\textit{awidth} \; \ONE$ & $\dn$ & $0$\\
|
|
|
3371 |
$\textit{awidth} \; c$ & $\dn$ & $1$\\
|
|
|
3372 |
$\textit{awidth} \; r_1 + r_2$ & $\dn$ & $\textit{awidth} \;
|
|
|
3373 |
r_1 + \textit{awidth} \; r_2$\\
|
|
|
3374 |
$\textit{awidth} \; r_1 \cdot r_2$ & $\dn$ & $\textit{awidth} \;
|
|
|
3375 |
r_1 + \textit{awidth} \; r_2$\\
|
|
|
3376 |
$\textit{awidth} \; r^*$ & $\dn$ & $\textit{awidth} \; r$\\
|
|
|
3377 |
\end{tabular}
|
|
|
3378 |
\end{center}
|
|
|
3379 |
|
|
532
|
3380 |
|
|
593
|
3381 |
|
|
532
|
3382 |
Antimirov\parencite{Antimirov95} has proven that
|
|
618
|
3383 |
$\textit{PDER}_{UNIV}(r) \leq \textit{awidth}(r)$,
|
|
532
|
3384 |
where $\textit{PDER}_{UNIV}(r)$ is a set of all possible subterms
|
|
|
3385 |
created by doing derivatives of $r$ against all possible strings.
|
|
|
3386 |
If we can make sure that at any moment in our lexing algorithm our
|
|
|
3387 |
intermediate result hold at most one copy of each of the
|
|
|
3388 |
subterms then we can get the same bound as Antimirov's.
|
|
|
3389 |
This leads to the algorithm in the next chapter.
|
|
|
3390 |
|
|
|
3391 |
|
|
|
3392 |
|
|
|
3393 |
|
|
|
3394 |
|
|
|
3395 |
%----------------------------------------------------------------------------------------
|
|
|
3396 |
% SECTION 1
|
|
|
3397 |
%----------------------------------------------------------------------------------------
|
|
|
3398 |
|
|
|
3399 |
|
|
|
3400 |
%-----------------------------------
|
|
|
3401 |
% SUBSECTION 1
|
|
|
3402 |
%-----------------------------------
|
|
618
|
3403 |
%\subsection{Syntactic Equivalence Under $\simp$}
|
|
|
3404 |
%We prove that minor differences can be annhilated
|
|
|
3405 |
%by $\simp$.
|
|
|
3406 |
%For example,
|
|
|
3407 |
%\begin{center}
|
|
|
3408 |
% $\simp \;(\simpALTs\; (\map \;(\_\backslash \; x)\; (\distinct \; \mathit{rs}\; \phi))) =
|
|
|
3409 |
% \simp \;(\simpALTs \;(\distinct \;(\map \;(\_ \backslash\; x) \; \mathit{rs}) \; \phi))$
|
|
|
3410 |
%\end{center}
|
|
532
|
3411 |
|