author | Christian Urban <christian.urban@kcl.ac.uk> |
Fri, 28 Jan 2022 12:02:25 +0000 | |
changeset 398 | dac6d27c99c6 |
parent 397 | e1b74d618f1b |
child 400 | 46e5566ad4ba |
permissions | -rwxr-xr-x |
396 | 1 |
\documentclass[runningheads]{lipics-v2021} |
2 |
\usepackage{times} |
|
3 |
\usepackage{isabelle} |
|
4 |
\usepackage{isabellesym} |
|
5 |
\usepackage{amsmath} |
|
6 |
\usepackage{amssymb} |
|
7 |
\usepackage{mathpartir} |
|
8 |
\usepackage{tikz} |
|
9 |
\usepackage{pgf} |
|
10 |
\usetikzlibrary{positioning} |
|
11 |
%\usepackage{pdfsetup} |
|
12 |
%\usepackage{stmaryrd} |
|
13 |
%\usepackage{url} |
|
14 |
%\usepackage{color} |
|
15 |
%\usepackage[safe]{tipa} |
|
16 |
%\usepackage[sc]{mathpazo} |
|
17 |
%\usepackage{fontspec} |
|
18 |
%\setmainfont[Ligatures=TeX]{Palatino Linotype} |
|
19 |
||
20 |
||
21 |
||
22 |
||
23 |
\urlstyle{rm} |
|
24 |
\isabellestyle{it} |
|
25 |
\renewcommand{\isastyleminor}{\it}% |
|
26 |
\renewcommand{\isastyle}{\normalsize\it}% |
|
27 |
||
28 |
||
29 |
\def\dn{\,\stackrel{\mbox{\scriptsize def}}{=}\,} |
|
30 |
\renewcommand{\isasymequiv}{$\dn$} |
|
31 |
\renewcommand{\isasymemptyset}{$\varnothing$} |
|
32 |
\renewcommand{\isacharunderscore}{\mbox{$\_\!\_$}} |
|
33 |
\renewcommand{\isasymiota}{\makebox[0mm]{${}^{\prime}$}} |
|
34 |
\renewcommand{\isasymin}{\ensuremath{\,\in\,}} |
|
35 |
||
36 |
||
37 |
\def\Brz{Brzozowski} |
|
38 |
\def\der{\backslash} |
|
39 |
\newtheorem{falsehood}{Falsehood} |
|
40 |
\newtheorem{conject}{Conjecture} |
|
41 |
||
42 |
\bibliographystyle{plainurl} |
|
43 |
||
44 |
\title{{POSIX} {L}exing with {B}itcoded {D}erivatives} |
|
45 |
\titlerunning{POSIX Lexing with Bitcoded Derivatives} |
|
46 |
\author{Chengsong Tan}{King's College London}{chengsong.tan@kcl.ac.uk}{}{} |
|
47 |
\author{Christian Urban}{King's College London}{christian.urban@kcl.ac.uk}{}{} |
|
398 | 48 |
\authorrunning{C.~Tan and C.~Urban} |
397
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
49 |
\keywords{POSIX matching, Derivatives of Regular Expressions, Isabelle/HOL} |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
50 |
\category{} |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
51 |
\ccsdesc[100]{Design and analysis of algorithms} |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
52 |
\ccsdesc[100]{Formal languages and automata theory} |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
53 |
\Copyright{\mbox{}} |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
54 |
\nolinenumbers |
396 | 55 |
|
56 |
||
57 |
\begin{document} |
|
58 |
\maketitle |
|
59 |
||
60 |
\begin{abstract} |
|
397
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
61 |
Sulzmann and Lu described a lexing algorithm that calculates |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
62 |
Brzozowski derivatives using bit-sequences annotated to regular |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
63 |
expressions. Their algorithm generates POSIX values which encode |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
64 |
the information of \emph{how} a regular expression matches a |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
65 |
string---that is, which part of the string is matched by which part |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
66 |
of the regular expression. The purpose of the bit-sequences in |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
67 |
Sulzmann and Lu's algorithm is to keep the size of derivatives small |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
68 |
which is achieved by `aggressively' simplifying regular expressions. |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
69 |
In this paper we describe a slight variant of Sulzmann and Lu's |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
70 |
algorithm and \textit{(i)} prove that this algorithm generates |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
71 |
unique POSIX values; \textit{(ii)} we also establish a cubic bound |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
72 |
for the size of the derivatives---in earlier works, derivatives can |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
73 |
grow exponentially even after simplification. |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
74 |
|
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
75 |
%Brzozowski introduced the notion of derivatives for regular |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
76 |
%expressions. They can be used for a very simple regular expression |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
77 |
%matching algorithm. Sulzmann and Lu cleverly extended this algorithm |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
78 |
%in order to deal with POSIX matching, which is the underlying |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
79 |
%disambiguation strategy for regular expressions needed in lexers. |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
80 |
%Their algorithm generates POSIX values which encode the information of |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
81 |
%\emph{how} a regular expression matches a string---that is, which part |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
82 |
%of the string is matched by which part of the regular expression. In |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
83 |
%this paper we give our inductive definition of what a POSIX value is |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
84 |
%and show $(i)$ that such a value is unique (for given regular |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
85 |
%expression and string being matched) and $(ii)$ that Sulzmann and Lu's |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
86 |
%algorithm always generates such a value (provided that the regular |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
87 |
%expression matches the string). We show that $(iii)$ our inductive |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
88 |
%definition of a POSIX value is equivalent to an alternative definition |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
89 |
%by Okui and Suzuki which identifies POSIX values as least elements |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
90 |
%according to an ordering of values. We also prove the correctness of |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
91 |
%Sulzmann's bitcoded version of the POSIX matching algorithm and extend the |
e1b74d618f1b
updated Sizebound4
Christian Urban <christian.urban@kcl.ac.uk>
parents:
396
diff
changeset
|
92 |
%results to additional constructors for regular expressions. \smallskip |
396 | 93 |
\end{abstract} |
94 |
||
95 |
||
96 |
||
97 |
\input{session} |
|
98 |
||
99 |
||
100 |
||
101 |
\end{document} |
|
102 |
||
103 |
%%% Local Variables: |
|
104 |
%%% mode: latex |
|
105 |
%%% TeX-master: t |
|
106 |
%%% End: |