X-Git-Url: https://bilbo.iut-bm.univ-fcomte.fr/and/gitweb/rairo15.git/blobdiff_plain/586298b57c6e1cec5566bbe692ac21c4c701fd51..039eee12186be85d7a74a188489abd12bfe554fd:/stopping.tex diff --git a/stopping.tex b/stopping.tex index 5bf7425..d095a3a 100644 --- a/stopping.tex +++ b/stopping.tex @@ -1,280 +1,249 @@ -\documentclass{article} -%\usepackage{prentcsmacro} -%\sloppy -\usepackage[a4paper]{geometry} -\geometry{hmargin=3cm, vmargin=3cm } - -\usepackage[latin1]{inputenc} -\usepackage[T1]{fontenc} -\usepackage[english]{babel} -\usepackage{amsmath,amssymb,latexsym,eufrak,euscript} -\usepackage{subfigure,pstricks,pst-node,pst-coil} - - -\usepackage{url,tikz} -\usepackage{pgflibrarysnakes} - -\usepackage{multicol} - -\usetikzlibrary{arrows} -\usetikzlibrary{automata} -\usetikzlibrary{snakes} -\usetikzlibrary{shapes} - -%% \setlength{\oddsidemargin}{15mm} -%% \setlength{\evensidemargin}{15mm} \setlength{\textwidth}{140mm} -%% \setlength{\textheight}{219mm} \setlength{\topmargin}{5mm} -\newtheorem{theorem}{Theorem} -%\newtheorem{definition}[theorem]{Definition} -% %\newtheorem{defis}[thm]{D\'efinitions} - \newtheorem{example}[theorem]{Example} -% %\newtheorem{Exes}[thm]{Exemples} -\newtheorem{lemma}[theorem]{Lemma} -\newtheorem{proposition}[theorem]{Proposition} -\newtheorem{construction}[theorem]{Construction} -\newtheorem{corollary}[theorem]{Corollary} -% \newtheorem{algor}[thm]{Algorithm} -%\newtheorem{propdef}[thm]{Proposition-D\'efinition} -\newcommand{\mlabel}[1]{\label{#1}\marginpar{\fbox{#1}}} -\newcommand{\flsup}[1]{\stackrel{#1}{\longrightarrow}} - -\newcommand{\stirlingtwo}[2]{\genfrac{\lbrace}{\rbrace}{0pt}{}{#1}{#2}} -\newcommand{\stirlingone}[2]{\genfrac{\lbrack}{\rbrack}{0pt}{}{#1}{#2}} - -\newenvironment{algo} -{ \vspace{1em} -\begin{algor}\mbox -\newline \vspace{-0.1em} -\begin{quote}\begin{rm}} -{\end{rm}\end{quote}\end{algor}\vspace{-1.5em}\vspace{2em}} -%\null \hfill $\diamondsuit$ \par\medskip \vspace{1em}} - -\newenvironment{exe} -{\begin{example}\rm } -{\end{example} -%\vspace*{-1.5em} -%\null \hfill $\triangledown$ \par\medskip} -%\null \hfill $\triangledown$ \par\medskip \vspace{1em}} -} - - -\newenvironment{proof} -{ \noindent {\sc Proof.\/} } -{\null \hfill $\Box$ \par\medskip \vspace{1em}} - - - -\newcommand {\tv}[1] {\lVert #1 \rVert_{\rm TV}} -\def \top {1.8} -\def \topt {2.3} -\def \P {\mathbb{P}} -\def \ov {\overline} -\def \ts {\tau_{\rm stop}} -\begin{document} -\label{firstpage} - -%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% -\section{Mathematical Backgroung} - - - -Let $\pi$, $\mu$ be two distribution on a same set $\Omega$. The total +This section considers functions $f: \Bool^n \rightarrow \Bool^n $ +issued from an hypercube where an Hamiltonian path has been removed. +A specific random walk in this modified hypercube is first +introduced. We further detail +a theoretical study on the length of the path +which is sufficient to follow to get a uniform distribution. + + + + + +First of all, let $\pi$, $\mu$ be two distributions on $\Bool^n$. The total variation distance between $\pi$ and $\mu$ is denoted $\tv{\pi-\mu}$ and is defined by -$$\tv{\pi-\mu}=\max_{A\subset \Omega} |\pi(A)-\mu(A)|.$$ It is known that -$$\tv{\pi-\mu}=\frac{1}{2}\sum_{x\in\Omega}|\pi(x)-\mu(x)|.$$ Moreover, if -$\nu$ is a distribution on $\Omega$, one has +$$\tv{\pi-\mu}=\max_{A\subset \Bool^n} |\pi(A)-\mu(A)|.$$ It is known that +$$\tv{\pi-\mu}=\frac{1}{2}\sum_{X\in\Bool^n}|\pi(X)-\mu(X)|.$$ Moreover, if +$\nu$ is a distribution on $\Bool^n$, one has $$\tv{\pi-\mu}\leq \tv{\pi-\nu}+\tv{\nu-\mu}$$ -Let $P$ be the matrix of a markov chain on $\Omega$. $P(x,\cdot)$ is the -distribution induced by the $x$-th row of $P$. If the markov chain induced by +Let $P$ be the matrix of a Markov chain on $\Bool^n$. $P(x,\cdot)$ is the +distribution induced by the $x$-th row of $P$. If the Markov chain induced by $P$ has a stationary distribution $\pi$, then we define -$$d(t)=\max_{x\in\Omega}\tv{P^t(x,\cdot)-\pi},$$ -and - -$$t_{\rm mix}(\varepsilon)=\min\{t \mid d(t)\leq \varepsilon\}.$$ -One can prove that +$$d(t)=\max_{X\in\Bool^n}\tv{P^t(X,\cdot)-\pi}.$$ +It is known that $d(t+1)\leq d(t)$. \JFC{references ? Cela a-t-il +un intérêt dans la preuve ensuite.} -$$t_{\rm mix}(\varepsilon)\leq \lceil\log_2(\varepsilon^{-1})\rceil t_{\rm mix}(\frac{1}{4})$$ -It is known that $d(t+1)\leq d(t)$. +%and +% $$t_{\rm mix}(\varepsilon)=\min\{t \mid d(t)\leq \varepsilon\}.$$ +% One can prove that \JFc{Ou cela a-t-il été fait?} +% $$t_{\rm mix}(\varepsilon)\leq \lceil\log_2(\varepsilon^{-1})\rceil t_{\rm mix}(\frac{1}{4})$$ -%% A {\it coupling} with transition matrix $P$ is a process $(X_t,Y_t)_{t\geq 0}$ -%% such that both $(X_t)$ and $(Y_t)$ are markov chains of matric $P$; moreover -%% it is required that if $X_s=Y_s$, then for any $t\geq s$, $X_t=Y_t$. -%% A results provides that if $(X_t,Y_t)_{t\geq 0}$ is a coupling, then -%% $$d(t)\leq \max_{x,y} P_{x,y}(\{\tau_{\rm couple} \geq t\}),$$ -%% with $\tau_{\rm couple}=\min_t\{X_t=Y_t\}$. -Let $(X_t)_{t\in \mathbb{N}}$ be a sequence of $\Omega$ valued random +Let $(X_t)_{t\in \mathbb{N}}$ be a sequence of $\Bool^n$ valued random variables. A $\mathbb{N}$-valued random variable $\tau$ is a {\it stopping time} for the sequence $(X_i)$ if for each $t$ there exists $B_t\subseteq -\omega^{t+1}$ such that $\{tau=t\}=\{(X_0,X_1,\ldots,X_t)\in B_t\}$. - -Let $(X_t)_{t\in \mathbb{N}}$ be a markov chain and $f(X_{t-1},Z_t)$ a -random mapping representation of the markov chain. A {\it randomized - stopping time} for the markov chain is a stopping time for -$(Z_t)_{t\in\mathbb{N}}$. It he markov chain is irreductible and has $\pi$ -as stationary distribution, then a {\it stationay time} $\tau$ is a -randomized stopping time (possibily depending on the starting position $x$), +(\Bool^n)^{t+1}$ such that $\{\tau=t\}=\{(X_0,X_1,\ldots,X_t)\in B_t\}$. +In other words, the event $\{\tau = t \}$ only depends on the values of +$(X_0,X_1,\ldots,X_t)$, not on $X_k$ with $k > t$. + + +\JFC{Je ne comprends pas la definition de randomized stopping time, Peut-on enrichir ?} + +Let $(X_t)_{t\in \mathbb{N}}$ be a Markov chain and $f(X_{t-1},Z_t)$ a +random mapping representation of the Markov chain. A {\it randomized + stopping time} for the Markov chain is a stopping time for +$(Z_t)_{t\in\mathbb{N}}$. If the Markov chain is irreducible and has $\pi$ +as stationary distribution, then a {\it stationary time} $\tau$ is a +randomized stopping time (possibly depending on the starting position $X$), such that the distribution of $X_\tau$ is $\pi$: -$$\P_x(X_\tau=y)=\pi(y).$$ +$$\P_X(X_\tau=Y)=\pi(Y).$$ + + +\JFC{Ou ceci a-t-il ete prouvé. On ne définit pas ce qu'est un strong stationary time.} +\begin{Theo} +If $\tau$ is a strong stationary time, then $d(t)\leq \max_{X\in\Bool^n} +\P_X(\tau > t)$. +\end{Theo} -\begin{proposition} -If $\tau$ is a strong stationary time, then $d(t)\leq \max_{x\in\Omega} -\P_x(\tau > t)$. -\end{proposition} -%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% -\section{Random walk on the modified Hypercube} +%Let $\Bool^n$ be the set of words of length $n$. +Let $E=\{(X,Y)\mid +X\in \Bool^n, Y\in \Bool^n,\ X=Y \text{ or } X\oplus Y \in 0^*10^*\}$. +In other words, $E$ is the set of all the edges in the classical +$n$-cube. +Let $h$ be a function from $\Bool^n$ into $\llbracket 1, n \rrbracket$. +Intuitively speaking $h$ aims at memorizing for each node +$X \in \Bool^n$ which edge is removed in the Hamiltonian cycle, +\textit{i.e.} which bit in $\llbracket 1, n \rrbracket$ +cannot be switched. -Let $\Omega=\{0,1\}^N$ be the set of words of length $N$. Let $E=\{(x,y)\mid -x\in \Omega, y\in \Omega,\ x=y \text{ or } x\oplus y \in 0^*10^*\}$. Let $h$ -be a function from $\Omega$ into $\{1,\ldots,N\}$. -We denote by $E_h$ the set $E\setminus\{(x,y)\mid x\oplus y = -0^{N-h(x)}10^{h(x)-1}\}$. We define the matrix $P_h$ has follows: + +We denote by $E_h$ the set $E\setminus\{(X,Y)\mid X\oplus Y = +0^{n-h(X)}10^{h(X)-1}\}$. This is the set of the modified hypercube, +\textit{i.e.}, the $n$-cube where the Hamiltonian cycle $h$ +has been removed. + +We define the Markov matrix $P_h$ for each line $X$ and +each column $Y$ as follows: $$\left\{ \begin{array}{ll} -P_h(x,y)=0 & \text{ if } (x,y)\notin E_h\\ -P_h(x,x)=\frac{1}{2}+\frac{1}{2N} & \\ -P_h(x,x)=\frac{1}{2N} & \text{otherwise}\\ - +P_h(X,X)=\frac{1}{2}+\frac{1}{2n} & \\ +P_h(X,Y)=0 & \textrm{if $(X,Y)\notin E_h$}\\ +P_h(X,Y)=\frac{1}{2n} & \textrm{if $X\neq Y$ and $(X,Y) \in E_h$} \end{array} \right. $$ -We denote by $\ov{h}$ the function from $\Omega$ into $\omega$ defined -by $x\oplus\ov{h}(x)=0^{N-h(x)}10^{h(x)-1}.$ -The function $\ov{h}$ is said {\it square-free} if for every $x\in E$, -$\ov{h}(\ov{h}(x))\neq x$. +We denote by $\ov{h} : \Bool^n \rightarrow \Bool^n$ the function +such that for any $X \in \Bool^n $, +$(X,\ov{h}(X)) \in E$ and $X\oplus\ov{h}(X)=0^{n-h(X)}10^{h(X)-1}$. +The function $\ov{h}$ is said {\it square-free} if for every $X\in \Bool^n$, +$\ov{h}(\ov{h}(X))\neq X$. -\begin{lemma}\label{lm:h} -If $\ov{h}$ is bijective and square-free, then $h(\ov{h}^{-1}(x))\neq h(x)$. -\end{lemma} +\begin{Lemma}\label{lm:h} +If $\ov{h}$ is bijective and square-free, then $h(\ov{h}^{-1}(X))\neq h(X)$. +\end{Lemma} \begin{proof} - +Let $\ov{h}$ be bijective. +Let $k\in \llbracket 1, n \rrbracket$ s.t. $h(\ov{h}^{-1}(X))=k$. +Then $(\ov{h}^{-1}(X),X)$ belongs to $E$ and +$\ov{h}^{-1}(X)\oplus X = 0^{n-k}10^{k-1}$. +Let us suppose $h(X) = h(\ov{h}^{-1}(X))$. In such a case, $h(X) =k$. +By definition of $\ov{h}$, $(X, \ov{h}(X)) \in E $ and +$X\oplus\ov{h}(X)=0^{n-h(X)}10^{h(X)-1} = 0^{n-k}10^{k-1}$. +Thus $\ov{h}(X)= \ov{h}^{-1}(X)$, which leads to $\ov{h}(\ov{h}(X))= X$. +This contradicts the square-freeness of $\ov{h}$. \end{proof} -Let $Z$ be a random variable over -$\{1,\ldots,N\}\times\{0,1\}$ uniformaly distributed. For $X\in \Omega$, we -define, with $Z=(i,x)$, +Let $Z$ be a random variable that is uniformly distributed over +$\llbracket 1, n \rrbracket \times \Bool$. +For $X\in \Bool^n$, we +define, with $Z=(i,b)$, $$ \left\{ \begin{array}{ll} -f(X,Z)=X\oplus (0^{N-i}10^{i-1}) & \text{if } x=1 \text{ and } i\neq h(X),\\ +f(X,Z)=X\oplus (0^{n-i}10^{i-1}) & \text{if } b=1 \text{ and } i\neq h(X),\\ f(X,Z)=X& \text{otherwise.} \end{array}\right. $$ -The pair $f,Z$ is a random mapping representation of $P_h$. +The Markov chain is thus defined as +$$ +X_t= f(X_{t-1},Z_t) +$$ +The pair $(f,Z)$ is a random mapping representation of $P_h$. +\JFC{interet de la phrase precedente} %%%%%%%%%%%%%%%%%%%%%%%%%%%ù -\section{Stopping time} - -An integer $\ell\in\{1,\ldots,N\}$ is said {\it fair} at time $t$ if there -exists $0\leq j