| author | Christian Urban <christian.urban@kcl.ac.uk> |
| Fri, 28 Jan 2022 12:02:25 +0000 | |
| changeset 398 | dac6d27c99c6 |
| parent 397 | e1b74d618f1b |
| child 400 | 46e5566ad4ba |
| permissions | -rwxr-xr-x |
| 396 | 1 |
\documentclass[runningheads]{lipics-v2021}
|
2 |
\usepackage{times}
|
|
3 |
\usepackage{isabelle}
|
|
4 |
\usepackage{isabellesym}
|
|
5 |
\usepackage{amsmath}
|
|
6 |
\usepackage{amssymb}
|
|
7 |
\usepackage{mathpartir}
|
|
8 |
\usepackage{tikz}
|
|
9 |
\usepackage{pgf}
|
|
10 |
\usetikzlibrary{positioning}
|
|
11 |
%\usepackage{pdfsetup}
|
|
12 |
%\usepackage{stmaryrd}
|
|
13 |
%\usepackage{url}
|
|
14 |
%\usepackage{color}
|
|
15 |
%\usepackage[safe]{tipa}
|
|
16 |
%\usepackage[sc]{mathpazo}
|
|
17 |
%\usepackage{fontspec}
|
|
18 |
%\setmainfont[Ligatures=TeX]{Palatino Linotype}
|
|
19 |
||
20 |
||
21 |
||
22 |
||
23 |
\urlstyle{rm}
|
|
24 |
\isabellestyle{it}
|
|
25 |
\renewcommand{\isastyleminor}{\it}%
|
|
26 |
\renewcommand{\isastyle}{\normalsize\it}%
|
|
27 |
||
28 |
||
29 |
\def\dn{\,\stackrel{\mbox{\scriptsize def}}{=}\,}
|
|
30 |
\renewcommand{\isasymequiv}{$\dn$}
|
|
31 |
\renewcommand{\isasymemptyset}{$\varnothing$}
|
|
32 |
\renewcommand{\isacharunderscore}{\mbox{$\_\!\_$}}
|
|
33 |
\renewcommand{\isasymiota}{\makebox[0mm]{${}^{\prime}$}}
|
|
34 |
\renewcommand{\isasymin}{\ensuremath{\,\in\,}}
|
|
35 |
||
36 |
||
37 |
\def\Brz{Brzozowski}
|
|
38 |
\def\der{\backslash}
|
|
39 |
\newtheorem{falsehood}{Falsehood}
|
|
40 |
\newtheorem{conject}{Conjecture}
|
|
41 |
||
42 |
\bibliographystyle{plainurl}
|
|
43 |
||
44 |
\title{{POSIX} {L}exing with {B}itcoded {D}erivatives}
|
|
45 |
\titlerunning{POSIX Lexing with Bitcoded Derivatives}
|
|
46 |
\author{Chengsong Tan}{King's College London}{chengsong.tan@kcl.ac.uk}{}{}
|
|
47 |
\author{Christian Urban}{King's College London}{christian.urban@kcl.ac.uk}{}{}
|
|
| 398 | 48 |
\authorrunning{C.~Tan and C.~Urban}
|
|
397
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
49 |
\keywords{POSIX matching, Derivatives of Regular Expressions, Isabelle/HOL}
|
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
50 |
\category{}
|
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
51 |
\ccsdesc[100]{Design and analysis of algorithms}
|
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
52 |
\ccsdesc[100]{Formal languages and automata theory}
|
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
53 |
\Copyright{\mbox{}}
|
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
54 |
\nolinenumbers |
| 396 | 55 |
|
56 |
||
57 |
\begin{document}
|
|
58 |
\maketitle |
|
59 |
||
60 |
\begin{abstract}
|
|
|
397
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
61 |
Sulzmann and Lu described a lexing algorithm that calculates |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
62 |
Brzozowski derivatives using bit-sequences annotated to regular |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
63 |
expressions. Their algorithm generates POSIX values which encode |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
64 |
the information of \emph{how} a regular expression matches a
|
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
65 |
string---that is, which part of the string is matched by which part |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
66 |
of the regular expression. The purpose of the bit-sequences in |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
67 |
Sulzmann and Lu's algorithm is to keep the size of derivatives small |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
68 |
which is achieved by `aggressively' simplifying regular expressions. |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
69 |
In this paper we describe a slight variant of Sulzmann and Lu's |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
70 |
algorithm and \textit{(i)} prove that this algorithm generates
|
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
71 |
unique POSIX values; \textit{(ii)} we also establish a cubic bound
|
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
72 |
for the size of the derivatives---in earlier works, derivatives can |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
73 |
grow exponentially even after simplification. |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
74 |
|
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
75 |
%Brzozowski introduced the notion of derivatives for regular |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
76 |
%expressions. They can be used for a very simple regular expression |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
77 |
%matching algorithm. Sulzmann and Lu cleverly extended this algorithm |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
78 |
%in order to deal with POSIX matching, which is the underlying |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
79 |
%disambiguation strategy for regular expressions needed in lexers. |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
80 |
%Their algorithm generates POSIX values which encode the information of |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
81 |
%\emph{how} a regular expression matches a string---that is, which part
|
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
82 |
%of the string is matched by which part of the regular expression. In |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
83 |
%this paper we give our inductive definition of what a POSIX value is |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
84 |
%and show $(i)$ that such a value is unique (for given regular |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
85 |
%expression and string being matched) and $(ii)$ that Sulzmann and Lu's |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
86 |
%algorithm always generates such a value (provided that the regular |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
87 |
%expression matches the string). We show that $(iii)$ our inductive |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
88 |
%definition of a POSIX value is equivalent to an alternative definition |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
89 |
%by Okui and Suzuki which identifies POSIX values as least elements |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
90 |
%according to an ordering of values. We also prove the correctness of |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
91 |
%Sulzmann's bitcoded version of the POSIX matching algorithm and extend the |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
92 |
%results to additional constructors for regular expressions. \smallskip |
| 396 | 93 |
\end{abstract}
|
94 |
||
95 |
||
96 |
||
97 |
\input{session}
|
|
98 |
||
99 |
||
100 |
||
101 |
\end{document}
|
|
102 |
||
103 |
%%% Local Variables: |
|
104 |
%%% mode: latex |
|
105 |
%%% TeX-master: t |
|
106 |
%%% End: |