1 %\documentclass{article}
2 \documentclass[10pt,journal,letterpaper,compsoc]{IEEEtran}
3 \usepackage[utf8]{inputenc}
4 \usepackage[T1]{fontenc}
11 \usepackage[ruled,vlined]{algorithm2e}
13 \usepackage[standard]{ntheorem}
15 % Pour mathds : les ensembles IR, IN, etc.
18 % Pour avoir des intervalles d'entiers
22 % Pour faire des sous-figures dans les figures
23 \usepackage{subfigure}
27 \newtheorem{notation}{Notation}
29 \newcommand{\X}{\mathcal{X}}
30 \newcommand{\Go}{G_{f_0}}
31 \newcommand{\B}{\mathds{B}}
32 \newcommand{\N}{\mathds{N}}
33 \newcommand{\BN}{\mathds{B}^\mathsf{N}}
36 \newcommand{\alert}[1]{\begin{color}{blue}\textit{#1}\end{color}}
38 \title{Efficient and Cryptographically Secure Generation of Chaotic Pseudorandom Numbers on GPU}
41 \author{Jacques M. Bahi, Rapha\"{e}l Couturier, Christophe
42 Guyeux, and Pierre-Cyrille Héam\thanks{Authors in alphabetic order}}
47 In this paper we present a new pseudorandom number generator (PRNG) on
48 graphics processing units (GPU). This PRNG is based on the so-called chaotic iterations. It
49 is firstly proven to be chaotic according to the Devaney's formulation. We thus propose an efficient
50 implementation for GPU that successfully passes the {\it BigCrush} tests, deemed to be the hardest
51 battery of tests in TestU01. Experiments show that this PRNG can generate
52 about 20 billion of random numbers per second on Tesla C1060 and NVidia GTX280
54 It is then established that, under reasonable assumptions, the proposed PRNG can be cryptographically
56 A chaotic version of the Blum-Goldwasser asymmetric key encryption scheme is finally proposed.
61 \section{Introduction}
63 Randomness is of importance in many fields such as scientific simulations or cryptography.
64 ``Random numbers'' can mainly be generated either by a deterministic and reproducible algorithm
65 called a pseudorandom number generator (PRNG), or by a physical non-deterministic
66 process having all the characteristics of a random noise, called a truly random number
68 In this paper, we focus on reproducible generators, useful for instance in
69 Monte-Carlo based simulators or in several cryptographic schemes.
70 These domains need PRNGs that are statistically irreproachable.
71 In some fields such as in numerical simulations, speed is a strong requirement
72 that is usually attained by using parallel architectures. In that case,
73 a recurrent problem is that a deflation of the statistical qualities is often
74 reported, when the parallelization of a good PRNG is realized.
75 This is why ad-hoc PRNGs for each possible architecture must be found to
76 achieve both speed and randomness.
77 On the other side, speed is not the main requirement in cryptography: the great
78 need is to define \emph{secure} generators able to withstand malicious
79 attacks. Roughly speaking, an attacker should not be able in practice to make
80 the distinction between numbers obtained with the secure generator and a true random
82 Finally, a small part of the community working in this domain focuses on a
83 third requirement, that is to define chaotic generators.
84 The main idea is to take benefits from a chaotic dynamical system to obtain a
85 generator that is unpredictable, disordered, sensible to its seed, or in other word chaotic.
86 Their desire is to map a given chaotic dynamics into a sequence that seems random
87 and unassailable due to chaos.
88 However, the chaotic maps used as a pattern are defined in the real line
89 whereas computers deal with finite precision numbers.
90 This distortion leads to a deflation of both chaotic properties and speed.
91 Furthermore, authors of such chaotic generators often claim their PRNG
92 as secure due to their chaos properties, but there is no obvious relation
93 between chaos and security as it is understood in cryptography.
94 This is why the use of chaos for PRNG still remains marginal and disputable.
96 The authors' opinion is that topological properties of disorder, as they are
97 properly defined in the mathematical theory of chaos, can reinforce the quality
98 of a PRNG. But they are not substitutable for security or statistical perfection.
99 Indeed, to the authors' mind, such properties can be useful in the two following situations. On the
100 one hand, a post-treatment based on a chaotic dynamical system can be applied
101 to a PRNG statistically deflective, in order to improve its statistical
102 properties. Such an improvement can be found, for instance, in~\cite{bgw09:ip,bcgr11:ip}.
103 On the other hand, chaos can be added to a fast, statistically perfect PRNG and/or a
104 cryptographically secure one, in case where chaos can be of interest,
105 \emph{only if these last properties are not lost during
106 the proposed post-treatment}. Such an assumption is behind this research work.
107 It leads to the attempts to define a
108 family of PRNGs that are chaotic while being fast and statistically perfect,
109 or cryptographically secure.
110 Let us finish this paragraph by noticing that, in this paper,
111 statistical perfection refers to the ability to pass the whole
112 {\it BigCrush} battery of tests, which is widely considered as the most
113 stringent statistical evaluation of a sequence claimed as random.
114 This battery can be found in the well-known TestU01 package~\cite{LEcuyerS07}.
115 Chaos, for its part, refers to the well-established definition of a
116 chaotic dynamical system proposed by Devaney~\cite{Devaney}.
119 In a previous work~\cite{bgw09:ip,guyeux10} we have proposed a post-treatment on PRNGs making them behave
120 as a chaotic dynamical system. Such a post-treatment leads to a new category of
121 PRNGs. We have shown that proofs of Devaney's chaos can be established for this
122 family, and that the sequence obtained after this post-treatment can pass the
123 NIST~\cite{Nist10}, DieHARD~\cite{Marsaglia1996}, and TestU01~\cite{LEcuyerS07} batteries of tests, even if the inputted generators
125 The proposition of this paper is to improve widely the speed of the formerly
126 proposed generator, without any lack of chaos or statistical properties.
127 In particular, a version of this PRNG on graphics processing units (GPU)
129 Although GPU was initially designed to accelerate
130 the manipulation of images, they are nowadays commonly used in many scientific
131 applications. Therefore, it is important to be able to generate pseudorandom
132 numbers inside a GPU when a scientific application runs in it. This remark
133 motivates our proposal of a chaotic and statistically perfect PRNG for GPU.
135 allows us to generate almost 20 billion of pseudorandom numbers per second.
136 Furthermore, we show that the proposed post-treatment preserves the
137 cryptographical security of the inputted PRNG, when this last has such a
139 Last, but not least, we propose a rewriting of the Blum-Goldwasser asymmetric
140 key encryption protocol by using the proposed method.
142 The remainder of this paper is organized as follows. In Section~\ref{section:related
143 works} we review some GPU implementations of PRNGs. Section~\ref{section:BASIC
144 RECALLS} gives some basic recalls on the well-known Devaney's formulation of chaos,
145 and on an iteration process called ``chaotic
146 iterations'' on which the post-treatment is based.
147 The proposed PRNG and its proof of chaos are given in Section~\ref{sec:pseudorandom}.
148 Section~\ref{sec:efficient PRNG} presents an efficient
149 implementation of this chaotic PRNG on a CPU, whereas Section~\ref{sec:efficient PRNG
150 gpu} describes and evaluates theoretically the GPU implementation.
151 Such generators are experimented in
152 Section~\ref{sec:experiments}.
153 We show in Section~\ref{sec:security analysis} that, if the inputted
154 generator is cryptographically secure, then it is the case too for the
155 generator provided by the post-treatment.
156 Such a proof leads to the proposition of a cryptographically secure and
157 chaotic generator on GPU based on the famous Blum Blum Shum
158 in Section~\ref{sec:CSGPU}, and to an improvement of the
159 Blum-Goldwasser protocol in Sect.~\ref{Blum-Goldwasser}.
160 This research work ends by a conclusion section, in which the contribution is
161 summarized and intended future work is presented.
166 \section{Related works on GPU based PRNGs}
167 \label{section:related works}
169 Numerous research works on defining GPU based PRNGs have already been proposed in the
170 literature, so that exhaustivity is impossible.
171 This is why authors of this document only give reference to the most significant attempts
172 in this domain, from their subjective point of view.
173 The quantity of pseudorandom numbers generated per second is mentioned here
174 only when the information is given in the related work.
175 A million numbers per second will be simply written as
176 1MSample/s whereas a billion numbers per second is 1GSample/s.
178 In \cite{Pang:2008:cec} a PRNG based on cellular automata is defined
179 with no requirement to an high precision integer arithmetic or to any bitwise
180 operations. Authors can generate about
181 3.2MSamples/s on a GeForce 7800 GTX GPU, which is quite an old card now.
182 However, there is neither a mention of statistical tests nor any proof of
183 chaos or cryptography in this document.
185 In \cite{ZRKB10}, the authors propose different versions of efficient GPU PRNGs
186 based on Lagged Fibonacci or Hybrid Taus. They have used these
187 PRNGs for Langevin simulations of biomolecules fully implemented on
188 GPU. Performances of the GPU versions are far better than those obtained with a
189 CPU, and these PRNGs succeed to pass the {\it BigCrush} battery of TestU01.
190 However the evaluations of the proposed PRNGs are only statistical ones.
193 Authors of~\cite{conf/fpga/ThomasHL09} have studied the implementation of some
194 PRNGs on different computing architectures: CPU, field-programmable gate array
195 (FPGA), massively parallel processors, and GPU. This study is of interest, because
196 the performance of the same PRNGs on different architectures are compared.
197 FPGA appears as the fastest and the most
198 efficient architecture, providing the fastest number of generated pseudorandom numbers
200 However, we notice that authors can ``only'' generate between 11 and 16GSamples/s
201 with a GTX 280 GPU, which should be compared with
202 the results presented in this document.
203 We can remark too that the PRNGs proposed in~\cite{conf/fpga/ThomasHL09} are only
204 able to pass the {\it Crush} battery, which is far easier than the {\it Big Crush} one.
206 Lastly, Cuda has developed a library for the generation of pseudorandom numbers called
207 Curand~\cite{curand11}. Several PRNGs are implemented, among
209 Xorwow~\cite{Marsaglia2003} and some variants of Sobol. The tests reported show that
210 their fastest version provides 15GSamples/s on the new Fermi C2050 card.
211 But their PRNGs cannot pass the whole TestU01 battery (only one test is failed).
214 We can finally remark that, to the best of our knowledge, no GPU implementation has been proven to be chaotic, and the cryptographically secure property has surprisingly never been considered.
216 \section{Basic Recalls}
217 \label{section:BASIC RECALLS}
219 This section is devoted to basic definitions and terminologies in the fields of
220 topological chaos and chaotic iterations.
221 \subsection{Devaney's Chaotic Dynamical Systems}
223 In the sequel $S^{n}$ denotes the $n^{th}$ term of a sequence $S$ and $V_{i}$
224 denotes the $i^{th}$ component of a vector $V$. $f^{k}=f\circ ...\circ f$
225 is for the $k^{th}$ composition of a function $f$. Finally, the following
226 notation is used: $\llbracket1;N\rrbracket=\{1,2,\hdots,N\}$.
229 Consider a topological space $(\mathcal{X},\tau)$ and a continuous function $f :
230 \mathcal{X} \rightarrow \mathcal{X}$.
233 $f$ is said to be \emph{topologically transitive} if, for any pair of open sets
234 $U,V \subset \mathcal{X}$, there exists $k>0$ such that $f^k(U) \cap V \neq
239 An element $x$ is a \emph{periodic point} for $f$ of period $n\in \mathds{N}^*$
240 if $f^{n}(x)=x$.% The set of periodic points of $f$ is denoted $Per(f).$
244 $f$ is said to be \emph{regular} on $(\mathcal{X}, \tau)$ if the set of periodic
245 points for $f$ is dense in $\mathcal{X}$: for any point $x$ in $\mathcal{X}$,
246 any neighborhood of $x$ contains at least one periodic point (without
247 necessarily the same period).
251 \begin{definition}[Devaney's formulation of chaos~\cite{Devaney}]
252 $f$ is said to be \emph{chaotic} on $(\mathcal{X},\tau)$ if $f$ is regular and
253 topologically transitive.
256 The chaos property is strongly linked to the notion of ``sensitivity'', defined
257 on a metric space $(\mathcal{X},d)$ by:
260 \label{sensitivity} $f$ has \emph{sensitive dependence on initial conditions}
261 if there exists $\delta >0$ such that, for any $x\in \mathcal{X}$ and any
262 neighborhood $V$ of $x$, there exist $y\in V$ and $n > 0$ such that
263 $d\left(f^{n}(x), f^{n}(y)\right) >\delta $.
265 $\delta$ is called the \emph{constant of sensitivity} of $f$.
268 Indeed, Banks \emph{et al.} have proven in~\cite{Banks92} that when $f$ is
269 chaotic and $(\mathcal{X}, d)$ is a metric space, then $f$ has the property of
270 sensitive dependence on initial conditions (this property was formerly an
271 element of the definition of chaos). To sum up, quoting Devaney
272 in~\cite{Devaney}, a chaotic dynamical system ``is unpredictable because of the
273 sensitive dependence on initial conditions. It cannot be broken down or
274 simplified into two subsystems which do not interact because of topological
275 transitivity. And in the midst of this random behavior, we nevertheless have an
276 element of regularity''. Fundamentally different behaviors are consequently
277 possible and occur in an unpredictable way.
281 \subsection{Chaotic Iterations}
282 \label{sec:chaotic iterations}
285 Let us consider a \emph{system} with a finite number $\mathsf{N} \in
286 \mathds{N}^*$ of elements (or \emph{cells}), so that each cell has a
287 Boolean \emph{state}. Having $\mathsf{N}$ Boolean values for these
288 cells leads to the definition of a particular \emph{state of the
289 system}. A sequence which elements belong to $\llbracket 1;\mathsf{N}
290 \rrbracket $ is called a \emph{strategy}. The set of all strategies is
291 denoted by $\llbracket 1, \mathsf{N} \rrbracket^\mathds{N}.$
294 \label{Def:chaotic iterations}
295 The set $\mathds{B}$ denoting $\{0,1\}$, let
296 $f:\mathds{B}^{\mathsf{N}}\longrightarrow \mathds{B}^{\mathsf{N}}$ be
297 a function and $S\in \llbracket 1, \mathsf{N} \rrbracket^\mathds{N}$ be a ``strategy''. The so-called
298 \emph{chaotic iterations} are defined by $x^0\in
299 \mathds{B}^{\mathsf{N}}$ and
301 \forall n\in \mathds{N}^{\ast }, \forall i\in
302 \llbracket1;\mathsf{N}\rrbracket ,x_i^n=\left\{
304 x_i^{n-1} & \text{ if }S^n\neq i \\
305 \left(f(x^{n-1})\right)_{S^n} & \text{ if }S^n=i.
310 In other words, at the $n^{th}$ iteration, only the $S^{n}-$th cell is
311 \textquotedblleft iterated\textquotedblright . Note that in a more
312 general formulation, $S^n$ can be a subset of components and
313 $\left(f(x^{n-1})\right)_{S^{n}}$ can be replaced by
314 $\left(f(x^{k})\right)_{S^{n}}$, where $k<n$, describing for example,
315 delays transmission~\cite{Robert1986,guyeux10}. Finally, let us remark that
316 the term ``chaotic'', in the name of these iterations, has \emph{a
317 priori} no link with the mathematical theory of chaos, presented above.
320 Let us now recall how to define a suitable metric space where chaotic iterations
321 are continuous. For further explanations, see, e.g., \cite{guyeux10}.
323 Let $\delta $ be the \emph{discrete Boolean metric}, $\delta
324 (x,y)=0\Leftrightarrow x=y.$ Given a function $f$, define the function:
325 %%RAPH : ici j'ai coupé la dernière ligne en 2, c'est moche mais bon
328 F_{f}: & \llbracket1;\mathsf{N}\rrbracket\times \mathds{B}^{\mathsf{N}} &
329 \longrightarrow & \mathds{B}^{\mathsf{N}} \\
330 & (k,E) & \longmapsto & \left( E_{j}.\delta (k,j)+ \right.\\
331 & & & \left. f(E)_{k}.\overline{\delta
332 (k,j)}\right) _{j\in \llbracket1;\mathsf{N}\rrbracket},%
335 \noindent where + and . are the Boolean addition and product operations.
336 Consider the phase space:
338 \mathcal{X} = \llbracket 1 ; \mathsf{N} \rrbracket^\mathds{N} \times
339 \mathds{B}^\mathsf{N},
341 \noindent and the map defined on $\mathcal{X}$:
343 G_f\left(S,E\right) = \left(\sigma(S), F_f(i(S),E)\right), \label{Gf}
345 \noindent where $\sigma$ is the \emph{shift} function defined by $\sigma
346 (S^{n})_{n\in \mathds{N}}\in \llbracket 1, \mathsf{N} \rrbracket^\mathds{N}\longrightarrow (S^{n+1})_{n\in
347 \mathds{N}}\in \llbracket 1, \mathsf{N} \rrbracket^\mathds{N}$ and $i$ is the \emph{initial function}
348 $i:(S^{n})_{n\in \mathds{N}} \in \llbracket 1, \mathsf{N} \rrbracket^\mathds{N}\longrightarrow S^{0}\in \llbracket
349 1;\mathsf{N}\rrbracket$. Then the chaotic iterations proposed in
350 Definition \ref{Def:chaotic iterations} can be described by the following iterations:
354 X^0 \in \mathcal{X} \\
360 With this formulation, a shift function appears as a component of chaotic
361 iterations. The shift function is a famous example of a chaotic
362 map~\cite{Devaney} but its presence is not sufficient enough to claim $G_f$ as
364 To study this claim, a new distance between two points $X = (S,E), Y =
365 (\check{S},\check{E})\in
366 \mathcal{X}$ has been introduced in \cite{guyeux10} as follows:
368 d(X,Y)=d_{e}(E,\check{E})+d_{s}(S,\check{S}),
374 \displaystyle{d_{e}(E,\check{E})} & = & \displaystyle{\sum_{k=1}^{\mathsf{N}%
375 }\delta (E_{k},\check{E}_{k})}, \\
376 \displaystyle{d_{s}(S,\check{S})} & = & \displaystyle{\dfrac{9}{\mathsf{N}}%
377 \sum_{k=1}^{\infty }\dfrac{|S^k-\check{S}^k|}{10^{k}}}.%
383 This new distance has been introduced to satisfy the following requirements.
385 \item When the number of different cells between two systems is increasing, then
386 their distance should increase too.
387 \item In addition, if two systems present the same cells and their respective
388 strategies start with the same terms, then the distance between these two points
389 must be small because the evolution of the two systems will be the same for a
390 while. Indeed, both dynamical systems start with the same initial condition,
391 use the same update function, and as strategies are the same for a while, furthermore
392 updated components are the same as well.
394 The distance presented above follows these recommendations. Indeed, if the floor
395 value $\lfloor d(X,Y)\rfloor $ is equal to $n$, then the systems $E, \check{E}$
396 differ in $n$ cells ($d_e$ is indeed the Hamming distance). In addition, $d(X,Y) - \lfloor d(X,Y) \rfloor $ is a
397 measure of the differences between strategies $S$ and $\check{S}$. More
398 precisely, this floating part is less than $10^{-k}$ if and only if the first
399 $k$ terms of the two strategies are equal. Moreover, if the $k^{th}$ digit is
400 nonzero, then the $k^{th}$ terms of the two strategies are different.
401 The impact of this choice for a distance will be investigated at the end of the document.
403 Finally, it has been established in \cite{guyeux10} that,
406 Let $f$ be a map from $\mathds{B}^\mathsf{N}$ to itself. Then $G_{f}$ is continuous in
407 the metric space $(\mathcal{X},d)$.
410 The chaotic property of $G_f$ has been firstly established for the vectorial
411 Boolean negation $f(x_1,\hdots, x_\mathsf{N}) = (\overline{x_1},\hdots, \overline{x_\mathsf{N}})$ \cite{guyeux10}. To obtain a characterization, we have secondly
412 introduced the notion of asynchronous iteration graph recalled bellow.
414 Let $f$ be a map from $\mathds{B}^\mathsf{N}$ to itself. The
415 {\emph{asynchronous iteration graph}} associated with $f$ is the
416 directed graph $\Gamma(f)$ defined by: the set of vertices is
417 $\mathds{B}^\mathsf{N}$; for all $x\in\mathds{B}^\mathsf{N}$ and
418 $i\in \llbracket1;\mathsf{N}\rrbracket$,
419 the graph $\Gamma(f)$ contains an arc from $x$ to $F_f(i,x)$.
420 The relation between $\Gamma(f)$ and $G_f$ is clear: there exists a
421 path from $x$ to $x'$ in $\Gamma(f)$ if and only if there exists a
422 strategy $s$ such that the parallel iteration of $G_f$ from the
423 initial point $(s,x)$ reaches the point $x'$.
424 We have then proven in \cite{bcgr11:ip} that,
428 \label{Th:Caractérisation des IC chaotiques}
429 Let $f:\mathds{B}^\mathsf{N}\to\mathds{B}^\mathsf{N}$. $G_f$ is chaotic (according to Devaney)
430 if and only if $\Gamma(f)$ is strongly connected.
433 Finally, we have established in \cite{bcgr11:ip} that,
435 Let $f: \mathds{B}^{n} \rightarrow \mathds{B}^{n}$, $\Gamma(f)$ its
436 iteration graph, $\check{M}$ its adjacency
438 a $n\times n$ matrix defined by
440 M_{ij} = \frac{1}{n}\check{M}_{ij}$ %\textrm{
442 $M_{ii} = 1 - \frac{1}{n} \sum\limits_{j=1, j\neq i}^n \check{M}_{ij}$ otherwise.
444 If $\Gamma(f)$ is strongly connected, then
445 the output of the PRNG detailed in Algorithm~\ref{CI Algorithm} follows
446 a law that tends to the uniform distribution
447 if and only if $M$ is a double stochastic matrix.
451 These results of chaos and uniform distribution have led us to study the possibility of building a
452 pseudorandom number generator (PRNG) based on the chaotic iterations.
453 As $G_f$, defined on the domain $\llbracket 1 ; \mathsf{N} \rrbracket^{\mathds{N}}
454 \times \mathds{B}^\mathsf{N}$, is built from Boolean networks $f : \mathds{B}^\mathsf{N}
455 \rightarrow \mathds{B}^\mathsf{N}$, we can preserve the theoretical properties on $G_f$
456 during implementations (due to the discrete nature of $f$). Indeed, it is as if
457 $\mathds{B}^\mathsf{N}$ represents the memory of the computer whereas $\llbracket 1 ; \mathsf{N}
458 \rrbracket^{\mathds{N}}$ is its input stream (the seeds, for instance, in PRNG, or a physical noise in TRNG).
459 Let us finally remark that the vectorial negation satisfies the hypotheses of both theorems above.
461 \section{Application to Pseudorandomness}
462 \label{sec:pseudorandom}
464 \subsection{A First Pseudorandom Number Generator}
466 We have proposed in~\cite{bgw09:ip} a new family of generators that receives
467 two PRNGs as inputs. These two generators are mixed with chaotic iterations,
468 leading thus to a new PRNG that improves the statistical properties of each
469 generator taken alone. Furthermore, our generator
470 possesses various chaos properties that none of the generators used as input
474 \begin{algorithm}[h!]
476 \KwIn{a function $f$, an iteration number $b$, an initial configuration $x^0$
478 \KwOut{a configuration $x$ ($n$ bits)}
480 $k\leftarrow b + \textit{XORshift}(b)$\;
483 $s\leftarrow{\textit{XORshift}(n)}$\;
484 $x\leftarrow{F_f(s,x)}$\;
488 \caption{PRNG with chaotic functions}
495 \begin{algorithm}[h!]
497 \KwIn{the internal configuration $z$ (a 32-bit word)}
498 \KwOut{$y$ (a 32-bit word)}
499 $z\leftarrow{z\oplus{(z\ll13)}}$\;
500 $z\leftarrow{z\oplus{(z\gg17)}}$\;
501 $z\leftarrow{z\oplus{(z\ll5)}}$\;
505 \caption{An arbitrary round of \textit{XORshift} algorithm}
513 This generator is synthesized in Algorithm~\ref{CI Algorithm}.
514 It takes as input: a Boolean function $f$ satisfying Theorem~\ref{Th:Caractérisation des IC chaotiques};
515 an integer $b$, ensuring that the number of executed iterations is at least $b$
516 and at most $2b+1$; and an initial configuration $x^0$.
517 It returns the new generated configuration $x$. Internally, it embeds two
518 \textit{XORshift}$(k)$ PRNGs~\cite{Marsaglia2003} that return integers
519 uniformly distributed
520 into $\llbracket 1 ; k \rrbracket$.
521 \textit{XORshift} is a category of very fast PRNGs designed by George Marsaglia,
522 which repeatedly uses the transform of exclusive or (XOR, $\oplus$) on a number
523 with a bit shifted version of it. This PRNG, which has a period of
524 $2^{32}-1=4.29\times10^9$, is summed up in Algorithm~\ref{XORshift}. It is used
525 in our PRNG to compute the strategy length and the strategy elements.
527 This former generator has successively passed various batteries of statistical tests, as the NIST~\cite{bcgr11:ip}, DieHARD~\cite{Marsaglia1996}, and TestU01~\cite{LEcuyerS07} ones.
529 \subsection{Improving the Speed of the Former Generator}
531 Instead of updating only one cell at each iteration, we can try to choose a
532 subset of components and to update them together. Such an attempt leads
533 to a kind of merger of the two sequences used in Algorithm
534 \ref{CI Algorithm}. When the updating function is the vectorial negation,
535 this algorithm can be rewritten as follows:
540 x^0 \in \llbracket 0, 2^\mathsf{N}-1 \rrbracket, S \in \llbracket 0, 2^\mathsf{N}-1 \rrbracket^\mathds{N} \\
541 \forall n \in \mathds{N}^*, x^n = x^{n-1} \oplus S^n,
544 \label{equation Oplus}
546 where $\oplus$ is for the bitwise exclusive or between two integers.
547 This rewriting can be understood as follows. The $n-$th term $S^n$ of the
548 sequence $S$, which is an integer of $\mathsf{N}$ binary digits, presents
549 the list of cells to update in the state $x^n$ of the system (represented
550 as an integer having $\mathsf{N}$ bits too). More precisely, the $k-$th
551 component of this state (a binary digit) changes if and only if the $k-$th
552 digit in the binary decomposition of $S^n$ is 1.
554 The single basic component presented in Eq.~\ref{equation Oplus} is of
555 ordinary use as a good elementary brick in various PRNGs. It corresponds
556 to the following discrete dynamical system in chaotic iterations:
559 \forall n\in \mathds{N}^{\ast }, \forall i\in
560 \llbracket1;\mathsf{N}\rrbracket ,x_i^n=\left\{
562 x_i^{n-1} & \text{ if } i \notin \mathcal{S}^n \\
563 \left(f(x^{n-1})\right)_{S^n} & \text{ if }i \in \mathcal{S}^n.
567 where $f$ is the vectorial negation and $\forall n \in \mathds{N}$,
568 $\mathcal{S}^n \subset \llbracket 1, \mathsf{N} \rrbracket$ is such that
569 $k \in \mathcal{S}^n$ if and only if the $k-$th digit in the binary
570 decomposition of $S^n$ is 1. Such chaotic iterations are more general
571 than the ones presented in Definition \ref{Def:chaotic iterations} because, instead of updating only one term at each iteration,
572 we select a subset of components to change.
575 Obviously, replacing Algorithm~\ref{CI Algorithm} by
576 Equation~\ref{equation Oplus}, which is possible when the iteration function is
577 the vectorial negation, leads to a speed improvement. However, proofs
578 of chaos obtained in~\cite{bg10:ij} have been established
579 only for chaotic iterations of the form presented in Definition
580 \ref{Def:chaotic iterations}. The question is now to determine whether the
581 use of more general chaotic iterations to generate pseudorandom numbers
582 faster, does not deflate their topological chaos properties.
584 \subsection{Proofs of Chaos of the General Formulation of the Chaotic Iterations}
586 Let us consider the discrete dynamical systems in chaotic iterations having
590 \forall n\in \mathds{N}^{\ast }, \forall i\in
591 \llbracket1;\mathsf{N}\rrbracket ,x_i^n=\left\{
593 x_i^{n-1} & \text{ if } i \notin \mathcal{S}^n \\
594 \left(f(x^{n-1})\right)_{S^n} & \text{ if }i \in \mathcal{S}^n.
599 In other words, at the $n^{th}$ iteration, only the cells whose id is
600 contained into the set $S^{n}$ are iterated.
602 Let us now rewrite these general chaotic iterations as usual discrete dynamical
603 system of the form $X^{n+1}=f(X^n)$ on an ad hoc metric space. Such a formulation
604 is required in order to study the topological behavior of the system.
606 Let us introduce the following function:
609 \chi: & \llbracket 1; \mathsf{N} \rrbracket \times \mathcal{P}\left(\llbracket 1; \mathsf{N} \rrbracket\right) & \longrightarrow & \mathds{B}\\
610 & (i,X) & \longmapsto & \left\{ \begin{array}{ll} 0 & \textrm{if }i \notin X, \\ 1 & \textrm{if }i \in X, \end{array}\right.
613 where $\mathcal{P}\left(X\right)$ is for the powerset of the set $X$, that is, $Y \in \mathcal{P}\left(X\right) \Longleftrightarrow Y \subset X$.
615 Given a function $f:\mathds{B}^\mathsf{N} \longrightarrow \mathds{B}^\mathsf{N} $, define the function:
616 %%RAPH : j'ai coupé la dernière ligne en 2, c'est moche
619 F_{f}: & \mathcal{P}\left(\llbracket1;\mathsf{N}\rrbracket \right) \times \mathds{B}^{\mathsf{N}} &
620 \longrightarrow & \mathds{B}^{\mathsf{N}} \\
621 & (P,E) & \longmapsto & \left( E_{j}.\chi (j,P)+\right.\\
622 & & &\left.f(E)_{j}.\overline{\chi(j,P)}\right) _{j\in \llbracket1;\mathsf{N}\rrbracket},%
625 where + and . are the Boolean addition and product operations, and $\overline{x}$
626 is the negation of the Boolean $x$.
627 Consider the phase space:
629 \mathcal{X} = \mathcal{P}\left(\llbracket 1 ; \mathsf{N} \rrbracket\right)^\mathds{N} \times
630 \mathds{B}^\mathsf{N},
632 \noindent and the map defined on $\mathcal{X}$:
634 G_f\left(S,E\right) = \left(\sigma(S), F_f(i(S),E)\right), \label{Gf}
636 \noindent where $\sigma$ is the \emph{shift} function defined by $\sigma
637 (S^{n})_{n\in \mathds{N}}\in \mathcal{P}\left(\llbracket 1 ; \mathsf{N} \rrbracket\right)^\mathds{N}\longrightarrow (S^{n+1})_{n\in
638 \mathds{N}}\in \mathcal{P}\left(\llbracket 1 ; \mathsf{N} \rrbracket\right)^\mathds{N}$ and $i$ is the \emph{initial function}
639 $i:(S^{n})_{n\in \mathds{N}} \in \mathcal{P}\left(\llbracket 1 ; \mathsf{N} \rrbracket\right)^\mathds{N}\longrightarrow S^{0}\in \mathcal{P}\left(\llbracket 1 ; \mathsf{N} \rrbracket\right)$.
640 Then the general chaotic iterations defined in Equation \ref{general CIs} can
641 be described by the following discrete dynamical system:
645 X^0 \in \mathcal{X} \\
651 Once more, a shift function appears as a component of these general chaotic
654 To study the Devaney's chaos property, a distance between two points
655 $X = (S,E), Y = (\check{S},\check{E})$ of $\mathcal{X}$ must be defined.
658 d(X,Y)=d_{e}(E,\check{E})+d_{s}(S,\check{S}),
661 \noindent where $ \displaystyle{d_{e}(E,\check{E})} = \displaystyle{\sum_{k=1}^{\mathsf{N}%
662 }\delta (E_{k},\check{E}_{k})}$ is once more the Hamming distance, and
663 $ \displaystyle{d_{s}(S,\check{S})} = \displaystyle{\dfrac{9}{\mathsf{N}}%
664 \sum_{k=1}^{\infty }\dfrac{|S^k\Delta {S}^k|}{10^{k}}}$,
665 %%RAPH : ici, j'ai supprimé tous les sauts à la ligne
668 %% \begin{array}{lll}
669 %% \displaystyle{d_{e}(E,\check{E})} & = & \displaystyle{\sum_{k=1}^{\mathsf{N}%
670 %% }\delta (E_{k},\check{E}_{k})} \textrm{ is once more the Hamming distance}, \\
671 %% \displaystyle{d_{s}(S,\check{S})} & = & \displaystyle{\dfrac{9}{\mathsf{N}}%
672 %% \sum_{k=1}^{\infty }\dfrac{|S^k\Delta {S}^k|}{10^{k}}}.%
676 where $|X|$ is the cardinality of a set $X$ and $A\Delta B$ is for the symmetric difference, defined for sets A, B as
677 $A\,\Delta\,B = (A \setminus B) \cup (B \setminus A)$.
681 The function $d$ defined in Eq.~\ref{nouveau d} is a metric on $\mathcal{X}$.
685 $d_e$ is the Hamming distance. We will prove that $d_s$ is a distance
686 too, thus $d$, as being the sum of two distances, will also be a distance.
688 \item Obviously, $d_s(S,\check{S})\geqslant 0$, and if $S=\check{S}$, then
689 $d_s(S,\check{S})=0$. Conversely, if $d_s(S,\check{S})=0$, then
690 $\forall k \in \mathds{N}, |S^k\Delta {S}^k|=0$, and so $\forall k, S^k=\check{S}^k$.
691 \item $d_s$ is symmetric
692 ($d_s(S,\check{S})=d_s(\check{S},S)$) due to the commutative property
693 of the symmetric difference.
694 \item Finally, $|S \Delta S''| = |(S \Delta \varnothing) \Delta S''|= |S \Delta (S'\Delta S') \Delta S''|= |(S \Delta S') \Delta (S' \Delta S'')|\leqslant |S \Delta S'| + |S' \Delta S''|$,
695 and so for all subsets $S,S',$ and $S''$ of $\llbracket 1, \mathsf{N} \rrbracket$,
696 we have $d_s(S,S'') \leqslant d_e(S,S')+d_s(S',S'')$, and the triangle
697 inequality is obtained.
702 Before being able to study the topological behavior of the general
703 chaotic iterations, we must first establish that:
706 For all $f:\mathds{B}^\mathsf{N} \longrightarrow \mathds{B}^\mathsf{N} $, the function $G_f$ is continuous on
707 $\left( \mathcal{X},d\right)$.
712 We use the sequential continuity.
713 Let $(S^n,E^n)_{n\in \mathds{N}}$ be a sequence of the phase space $%
714 \mathcal{X}$, which converges to $(S,E)$. We will prove that $\left(
715 G_{f}(S^n,E^n)\right) _{n\in \mathds{N}}$ converges to $\left(
716 G_{f}(S,E)\right) $. Let us remark that for all $n$, $S^n$ is a strategy,
717 thus, we consider a sequence of strategies (\emph{i.e.}, a sequence of
719 As $d((S^n,E^n);(S,E))$ converges to 0, each distance $d_{e}(E^n,E)$ and $d_{s}(S^n,S)$ converges
720 to 0. But $d_{e}(E^n,E)$ is an integer, so $\exists n_{0}\in \mathds{N},$ $%
721 d_{e}(E^n,E)=0$ for any $n\geqslant n_{0}$.\newline
722 In other words, there exists a threshold $n_{0}\in \mathds{N}$ after which no
723 cell will change its state:
724 $\exists n_{0}\in \mathds{N},n\geqslant n_{0}\Rightarrow E^n = E.$
726 In addition, $d_{s}(S^n,S)\longrightarrow 0,$ so $\exists n_{1}\in %
727 \mathds{N},d_{s}(S^n,S)<10^{-1}$ for all indexes greater than or equal to $%
728 n_{1}$. This means that for $n\geqslant n_{1}$, all the $S^n$ have the same
729 first term, which is $S^0$: $\forall n\geqslant n_{1},S_0^n=S_0.$
731 Thus, after the $max(n_{0},n_{1})^{th}$ term, states of $E^n$ and $E$ are
732 identical and strategies $S^n$ and $S$ start with the same first term.\newline
733 Consequently, states of $G_{f}(S^n,E^n)$ and $G_{f}(S,E)$ are equal,
734 so, after the $max(n_0, n_1)^{th}$ term, the distance $d$ between these two points is strictly less than 1.\newline
735 \noindent We now prove that the distance between $\left(
736 G_{f}(S^n,E^n)\right) $ and $\left( G_{f}(S,E)\right) $ is convergent to
737 0. Let $\varepsilon >0$. \medskip
739 \item If $\varepsilon \geqslant 1$, we see that the distance
740 between $\left( G_{f}(S^n,E^n)\right) $ and $\left( G_{f}(S,E)\right) $ is
741 strictly less than 1 after the $max(n_{0},n_{1})^{th}$ term (same state).
743 \item If $\varepsilon <1$, then $\exists k\in \mathds{N},10^{-k}\geqslant
744 \varepsilon > 10^{-(k+1)}$. But $d_{s}(S^n,S)$ converges to 0, so
746 \exists n_{2}\in \mathds{N},\forall n\geqslant
747 n_{2},d_{s}(S^n,S)<10^{-(k+2)},
749 thus after $n_{2}$, the $k+2$ first terms of $S^n$ and $S$ are equal.
751 \noindent As a consequence, the $k+1$ first entries of the strategies of $%
752 G_{f}(S^n,E^n)$ and $G_{f}(S,E)$ are the same ($G_{f}$ is a shift of strategies) and due to the definition of $d_{s}$, the floating part of
753 the distance between $(S^n,E^n)$ and $(S,E)$ is strictly less than $%
754 10^{-(k+1)}\leqslant \varepsilon $.\bigskip \newline
756 %%RAPH : ici j'ai rajouté une ligne
758 \forall \varepsilon >0,\exists N_{0}=max(n_{0},n_{1},n_{2})\in \mathds{N}%
759 ,\forall n\geqslant N_{0},$$
760 $$ d\left( G_{f}(S^n,E^n);G_{f}(S,E)\right)
761 \leqslant \varepsilon .
764 $G_{f}$ is consequently continuous.
768 It is now possible to study the topological behavior of the general chaotic
769 iterations. We will prove that,
772 \label{t:chaos des general}
773 The general chaotic iterations defined on Equation~\ref{general CIs} satisfy
774 the Devaney's property of chaos.
777 Let us firstly prove the following lemma.
779 \begin{lemma}[Strong transitivity]
781 For all couples $X,Y \in \mathcal{X}$ and any neighborhood $V$ of $X$, we can
782 find $n \in \mathds{N}^*$ and $X' \in V$ such that $G^n(X')=Y$.
786 Let $X=(S,E)$, $\varepsilon>0$, and $k_0 = \lfloor log_{10}(\varepsilon)+1 \rfloor$.
787 Any point $X'=(S',E')$ such that $E'=E$ and $\forall k \leqslant k_0, S'^k=S^k$,
788 are in the open ball $\mathcal{B}\left(X,\varepsilon\right)$. Let us define
789 $\check{X} = \left(\check{S},\check{E}\right)$, where $\check{X}= G^{k_0}(X)$.
790 We denote by $s\subset \llbracket 1; \mathsf{N} \rrbracket$ the set of coordinates
791 that are different between $\check{E}$ and the state of $Y$. Thus each point $X'$ of
792 the form $(S',E')$ where $E'=E$ and $S'$ starts with
793 $(S^0, S^1, \hdots, S^{k_0},s,\hdots)$, verifies the following properties:
795 \item $X'$ is in $\mathcal{B}\left(X,\varepsilon\right)$,
796 \item the state of $G_f^{k_0+1}(X')$ is the state of $Y$.
798 Finally the point $\left(\left(S^0, S^1, \hdots, S^{k_0},s,s^0, s^1, \hdots\right); E\right)$,
799 where $(s^0,s^1, \hdots)$ is the strategy of $Y$, satisfies the properties
800 claimed in the lemma.
803 We can now prove Theorem~\ref{t:chaos des general}...
805 \begin{proof}[Theorem~\ref{t:chaos des general}]
806 Firstly, strong transitivity implies transitivity.
808 Let $(S,E) \in\mathcal{X}$ and $\varepsilon >0$. To
809 prove that $G_f$ is regular, it is sufficient to prove that
810 there exists a strategy $\tilde S$ such that the distance between
811 $(\tilde S,E)$ and $(S,E)$ is less than $\varepsilon$, and such that
812 $(\tilde S,E)$ is a periodic point.
814 Let $t_1=\lfloor-\log_{10}(\varepsilon)\rfloor$, and let $E'$ be the
815 configuration that we obtain from $(S,E)$ after $t_1$ iterations of
816 $G_f$. As $G_f$ is strongly transitive, there exists a strategy $S'$
817 and $t_2\in\mathds{N}$ such
818 that $E$ is reached from $(S',E')$ after $t_2$ iterations of $G_f$.
820 Consider the strategy $\tilde S$ that alternates the first $t_1$ terms
821 of $S$ and the first $t_2$ terms of $S'$:
822 %%RAPH : j'ai coupé la ligne en 2
824 S=(S_0,\dots,S_{t_1-1},S'_0,\dots,S'_{t_2-1},S_0,$$$$\dots,S_{t_1-1},S'_0,\dots,S'_{t_2-1},S_0,\dots).$$ It
825 is clear that $(\tilde S,E)$ is obtained from $(\tilde S,E)$ after
826 $t_1+t_2$ iterations of $G_f$. So $(\tilde S,E)$ is a periodic
827 point. Since $\tilde S_t=S_t$ for $t<t_1$, by the choice of $t_1$, we
828 have $d((S,E),(\tilde S,E))<\epsilon$.
833 \section{Efficient PRNG based on Chaotic Iterations}
834 \label{sec:efficient PRNG}
836 Based on the proof presented in the previous section, it is now possible to
837 improve the speed of the generator formerly presented in~\cite{bgw09:ip,guyeux10}.
838 The first idea is to consider
839 that the provided strategy is a pseudorandom Boolean vector obtained by a
841 An iteration of the system is simply the bitwise exclusive or between
842 the last computed state and the current strategy.
843 Topological properties of disorder exhibited by chaotic
844 iterations can be inherited by the inputted generator, we hope by doing so to
845 obtain some statistical improvements while preserving speed.
847 %%RAPH : j'ai viré tout ca
848 %% Let us give an example using 16-bits numbers, to clearly understand how the bitwise xor operations
851 %% Suppose that $x$ and the strategy $S^i$ are given as
853 %% Table~\ref{TableExemple} shows the result of $x \oplus S^i$.
856 %% \begin{scriptsize}
858 %% \begin{array}{|cc|cccccccccccccccc|}
860 %% x &=&1&0&1&1&1&0&1&0&1&0&0&1&0&0&1&0\\
862 %% S^i &=&0&1&1&0&0&1&1&0&1&1&1&0&0&1&1&1\\
864 %% x \oplus S^i&=&1&1&0&1&1&1&0&0&0&1&1&1&0&1&0&1\\
871 %% \caption{Example of an arbitrary round of the proposed generator}
872 %% \label{TableExemple}
878 \lstset{language=C,caption={C code of the sequential PRNG based on chaotic iterations},label=algo:seqCIPRNG}
882 unsigned int CIPRNG() {
883 static unsigned int x = 123123123;
884 unsigned long t1 = xorshift();
885 unsigned long t2 = xor128();
886 unsigned long t3 = xorwow();
887 x = x^(unsigned int)t1;
888 x = x^(unsigned int)(t2>>32);
889 x = x^(unsigned int)(t3>>32);
890 x = x^(unsigned int)t2;
891 x = x^(unsigned int)(t1>>32);
892 x = x^(unsigned int)t3;
900 In Listing~\ref{algo:seqCIPRNG} a sequential version of the proposed PRNG based
901 on chaotic iterations is presented. The xor operator is represented by
902 \textasciicircum. This function uses three classical 64-bits PRNGs, namely the
903 \texttt{xorshift}, the \texttt{xor128}, and the
904 \texttt{xorwow}~\cite{Marsaglia2003}. In the following, we call them ``xor-like
905 PRNGs''. As each xor-like PRNG uses 64-bits whereas our proposed generator
906 works with 32-bits, we use the command \texttt{(unsigned int)}, that selects the
907 32 least significant bits of a given integer, and the code \texttt{(unsigned
908 int)(t$>>$32)} in order to obtain the 32 most significant bits of \texttt{t}.
910 Thus producing a pseudorandom number needs 6 xor operations with 6 32-bits numbers
911 that are provided by 3 64-bits PRNGs. This version successfully passes the
912 stringent BigCrush battery of tests~\cite{LEcuyerS07}.
914 \section{Efficient PRNGs based on Chaotic Iterations on GPU}
915 \label{sec:efficient PRNG gpu}
917 In order to take benefits from the computing power of GPU, a program
918 needs to have independent blocks of threads that can be computed
919 simultaneously. In general, the larger the number of threads is, the
920 more local memory is used, and the less branching instructions are
921 used (if, while, ...), the better the performances on GPU is.
922 Obviously, having these requirements in mind, it is possible to build
923 a program similar to the one presented in Listing
924 \ref{algo:seqCIPRNG}, which computes pseudorandom numbers on GPU. To
925 do so, we must firstly recall that in the CUDA~\cite{Nvid10}
926 environment, threads have a local identifier called
927 \texttt{ThreadIdx}, which is relative to the block containing
928 them. Furthermore, in CUDA, parts of the code that are executed by the GPU, are
929 called {\it kernels}.
932 \subsection{Naive Version for GPU}
935 It is possible to deduce from the CPU version a quite similar version adapted to GPU.
936 The simple principle consists in making each thread of the GPU computing the CPU version of our PRNG.
937 Of course, the three xor-like
938 PRNGs used in these computations must have different parameters.
939 In a given thread, these parameters are
940 randomly picked from another PRNGs.
941 The initialization stage is performed by the CPU.
942 To do it, the ISAAC PRNG~\cite{Jenkins96} is used to set all the
943 parameters embedded into each thread.
945 The implementation of the three
946 xor-like PRNGs is straightforward when their parameters have been
947 allocated in the GPU memory. Each xor-like works with an internal
948 number $x$ that saves the last generated pseudorandom number. Additionally, the
949 implementation of the xor128, the xorshift, and the xorwow respectively require
950 4, 5, and 6 unsigned long as internal variables.
955 \KwIn{InternalVarXorLikeArray: array with internal variables of the 3 xor-like
956 PRNGs in global memory\;
957 NumThreads: number of threads\;}
958 \KwOut{NewNb: array containing random numbers in global memory}
959 \If{threadIdx is concerned by the computation} {
960 retrieve data from InternalVarXorLikeArray[threadIdx] in local variables\;
962 compute a new PRNG as in Listing\ref{algo:seqCIPRNG}\;
963 store the new PRNG in NewNb[NumThreads*threadIdx+i]\;
965 store internal variables in InternalVarXorLikeArray[threadIdx]\;
968 \caption{Main kernel of the GPU ``naive'' version of the PRNG based on chaotic iterations}
969 \label{algo:gpu_kernel}
974 Algorithm~\ref{algo:gpu_kernel} presents a naive implementation of the proposed PRNG on
975 GPU. Due to the available memory in the GPU and the number of threads
976 used simultaneously, the number of random numbers that a thread can generate
977 inside a kernel is limited (\emph{i.e.}, the variable \texttt{n} in
978 algorithm~\ref{algo:gpu_kernel}). For instance, if $100,000$ threads are used and
979 if $n=100$\footnote{in fact, we need to add the initial seed (a 32-bits number)},
980 then the memory required to store all of the internals variables of both the xor-like
981 PRNGs\footnote{we multiply this number by $2$ in order to count 32-bits numbers}
982 and the pseudorandom numbers generated by our PRNG, is equal to $100,000\times ((4+5+6)\times
983 2+(1+100))=1,310,000$ 32-bits numbers, that is, approximately $52$Mb.
985 This generator is able to pass the whole BigCrush battery of tests, for all
986 the versions that have been tested depending on their number of threads
987 (called \texttt{NumThreads} in our algorithm, tested up to $5$ million).
990 The proposed algorithm has the advantage of manipulating independent
991 PRNGs, so this version is easily adaptable on a cluster of computers too. The only thing
992 to ensure is to use a single ISAAC PRNG. To achieve this requirement, a simple solution consists in
993 using a master node for the initialization. This master node computes the initial parameters
994 for all the different nodes involved in the computation.
997 \subsection{Improved Version for GPU}
999 As GPU cards using CUDA have shared memory between threads of the same block, it
1000 is possible to use this feature in order to simplify the previous algorithm,
1001 i.e., to use less than 3 xor-like PRNGs. The solution consists in computing only
1002 one xor-like PRNG by thread, saving it into the shared memory, and then to use the results
1003 of some other threads in the same block of threads. In order to define which
1004 thread uses the result of which other one, we can use a combination array that
1005 contains the indexes of all threads and for which a combination has been
1008 In Algorithm~\ref{algo:gpu_kernel2}, two combination arrays are used. The
1009 variable \texttt{offset} is computed using the value of
1010 \texttt{combination\_size}. Then we can compute \texttt{o1} and \texttt{o2}
1011 representing the indexes of the other threads whose results are used by the
1012 current one. In this algorithm, we consider that a 32-bits xor-like PRNG has
1013 been chosen. In practice, we use the xor128 proposed in~\cite{Marsaglia2003} in
1014 which unsigned longs (64 bits) have been replaced by unsigned integers (32
1017 This version can also pass the whole {\it BigCrush} battery of tests.
1021 \KwIn{InternalVarXorLikeArray: array with internal variables of 1 xor-like PRNGs
1023 NumThreads: Number of threads\;
1024 array\_comb1, array\_comb2: Arrays containing combinations of size combination\_size\;}
1026 \KwOut{NewNb: array containing random numbers in global memory}
1027 \If{threadId is concerned} {
1028 retrieve data from InternalVarXorLikeArray[threadId] in local variables including shared memory and x\;
1029 offset = threadIdx\%combination\_size\;
1030 o1 = threadIdx-offset+array\_comb1[offset]\;
1031 o2 = threadIdx-offset+array\_comb2[offset]\;
1034 t=t\textasciicircum shmem[o1]\textasciicircum shmem[o2]\;
1035 shared\_mem[threadId]=t\;
1036 x = x\textasciicircum t\;
1038 store the new PRNG in NewNb[NumThreads*threadId+i]\;
1040 store internal variables in InternalVarXorLikeArray[threadId]\;
1043 \caption{Main kernel for the chaotic iterations based PRNG GPU efficient
1045 \label{algo:gpu_kernel2}
1048 \subsection{Theoretical Evaluation of the Improved Version}
1050 A run of Algorithm~\ref{algo:gpu_kernel2} consists in an operation ($x=x\oplus t$) having
1051 the form of Equation~\ref{equation Oplus}, which is equivalent to the iterative
1052 system of Eq.~\ref{eq:generalIC}. That is, an iteration of the general chaotic
1053 iterations is realized between the last stored value $x$ of the thread and a strategy $t$
1054 (obtained by a bitwise exclusive or between a value provided by a xor-like() call
1055 and two values previously obtained by two other threads).
1056 To be certain that we are in the framework of Theorem~\ref{t:chaos des general},
1057 we must guarantee that this dynamical system iterates on the space
1058 $\mathcal{X} = \mathcal{P}\left(\llbracket 1, \mathsf{N} \rrbracket\right)^\mathds{N}\times\mathds{B}^\mathsf{N}$.
1059 The left term $x$ obviously belongs to $\mathds{B}^ \mathsf{N}$.
1060 To prevent from any flaws of chaotic properties, we must check that the right
1061 term (the last $t$), corresponding to the strategies, can possibly be equal to any
1062 integer of $\llbracket 1, \mathsf{N} \rrbracket$.
1064 Such a result is obvious, as for the xor-like(), all the
1065 integers belonging into its interval of definition can occur at each iteration, and thus the
1066 last $t$ respects the requirement. Furthermore, it is possible to
1067 prove by an immediate mathematical induction that, as the initial $x$
1068 is uniformly distributed (it is provided by a cryptographically secure PRNG),
1069 the two other stored values shmem[o1] and shmem[o2] are uniformly distributed too,
1070 (this is the induction hypothesis), and thus the next $x$ is finally uniformly distributed.
1072 Thus Algorithm~\ref{algo:gpu_kernel2} is a concrete realization of the general
1073 chaotic iterations presented previously, and for this reason, it satisfies the
1074 Devaney's formulation of a chaotic behavior.
1076 \section{Experiments}
1077 \label{sec:experiments}
1079 Different experiments have been performed in order to measure the generation
1080 speed. We have used a first computer equipped with a Tesla C1060 NVidia GPU card
1082 Intel Xeon E5530 cadenced at 2.40 GHz, and
1083 a second computer equipped with a smaller CPU and a GeForce GTX 280.
1085 cards have 240 cores.
1087 In Figure~\ref{fig:time_xorlike_gpu} we compare the quantity of pseudorandom numbers
1088 generated per second with various xor-like based PRNGs. In this figure, the optimized
1089 versions use the {\it xor64} described in~\cite{Marsaglia2003}, whereas the naive versions
1090 embed the three xor-like PRNGs described in Listing~\ref{algo:seqCIPRNG}. In
1091 order to obtain the optimal performances, the storage of pseudorandom numbers
1092 into the GPU memory has been removed. This step is time consuming and slows down the numbers
1093 generation. Moreover this storage is completely
1094 useless, in case of applications that consume the pseudorandom
1095 numbers directly after generation. We can see that when the number of threads is greater
1096 than approximately 30,000 and lower than 5 million, the number of pseudorandom numbers generated
1097 per second is almost constant. With the naive version, this value ranges from 2.5 to
1098 3GSamples/s. With the optimized version, it is approximately equal to
1099 20GSamples/s. Finally we can remark that both GPU cards are quite similar, but in
1100 practice, the Tesla C1060 has more memory than the GTX 280, and this memory
1101 should be of better quality.
1102 As a comparison, Listing~\ref{algo:seqCIPRNG} leads to the generation of about
1103 138MSample/s when using one core of the Xeon E5530.
1105 \begin{figure}[htbp]
1107 \includegraphics[width=\columnwidth]{curve_time_xorlike_gpu.pdf}
1109 \caption{Quantity of pseudorandom numbers generated per second with the xorlike-based PRNG}
1110 \label{fig:time_xorlike_gpu}
1117 In Figure~\ref{fig:time_bbs_gpu} we highlight the performances of the optimized
1118 BBS-based PRNG on GPU. On the Tesla C1060 we obtain approximately 700MSample/s
1119 and on the GTX 280 about 670MSample/s, which is obviously slower than the
1120 xorlike-based PRNG on GPU. However, we will show in the next sections that this
1121 new PRNG has a strong level of security, which is necessarily paid by a speed
1124 \begin{figure}[htbp]
1126 \includegraphics[width=\columnwidth]{curve_time_bbs_gpu.pdf}
1128 \caption{Quantity of pseudorandom numbers generated per second using the BBS-based PRNG}
1129 \label{fig:time_bbs_gpu}
1132 All these experiments allow us to conclude that it is possible to
1133 generate a very large quantity of pseudorandom numbers statistically perfect with the xor-like version.
1134 To a certain extend, it is also the case with the secure BBS-based version, the speed deflation being
1135 explained by the fact that the former version has ``only''
1136 chaotic properties and statistical perfection, whereas the latter is also cryptographically secure,
1137 as it is shown in the next sections.
1145 \section{Security Analysis}
1146 \label{sec:security analysis}
1150 In this section the concatenation of two strings $u$ and $v$ is classically
1152 In a cryptographic context, a pseudorandom generator is a deterministic
1153 algorithm $G$ transforming strings into strings and such that, for any
1154 seed $s$ of length $m$, $G(s)$ (the output of $G$ on the input $s$) has size
1155 $\ell_G(m)$ with $\ell_G(m)>m$.
1156 The notion of {\it secure} PRNGs can now be defined as follows.
1159 A cryptographic PRNG $G$ is secure if for any probabilistic polynomial time
1160 algorithm $D$, for any positive polynomial $p$, and for all sufficiently
1162 $$| \mathrm{Pr}[D(G(U_m))=1]-Pr[D(U_{\ell_G(m)})=1]|< \frac{1}{p(m)},$$
1163 where $U_r$ is the uniform distribution over $\{0,1\}^r$ and the
1164 probabilities are taken over $U_m$, $U_{\ell_G(m)}$ as well as over the
1165 internal coin tosses of $D$.
1168 Intuitively, it means that there is no polynomial time algorithm that can
1169 distinguish a perfect uniform random generator from $G$ with a non
1170 negligible probability. The interested reader is referred
1171 to~\cite[chapter~3]{Goldreich} for more information. Note that it is
1172 quite easily possible to change the function $\ell$ into any polynomial
1173 function $\ell^\prime$ satisfying $\ell^\prime(m)>m)$~\cite[Chapter 3.3]{Goldreich}.
1175 The generation schema developed in (\ref{equation Oplus}) is based on a
1176 pseudorandom generator. Let $H$ be a cryptographic PRNG. We may assume,
1177 without loss of generality, that for any string $S_0$ of size $N$, the size
1178 of $H(S_0)$ is $kN$, with $k>2$. It means that $\ell_H(N)=kN$.
1179 Let $S_1,\ldots,S_k$ be the
1180 strings of length $N$ such that $H(S_0)=S_1 \ldots S_k$ ($H(S_0)$ is the concatenation of
1181 the $S_i$'s). The cryptographic PRNG $X$ defined in (\ref{equation Oplus})
1182 is the algorithm mapping any string of length $2N$ $x_0S_0$ into the string
1183 $(x_0\oplus S_0 \oplus S_1)(x_0\oplus S_0 \oplus S_1\oplus S_2)\ldots
1184 (x_o\bigoplus_{i=0}^{i=k}S_i)$. One in particular has $\ell_{X}(2N)=kN=\ell_H(N)$.
1185 We claim now that if this PRNG is secure,
1186 then the new one is secure too.
1189 \label{cryptopreuve}
1190 If $H$ is a secure cryptographic PRNG, then $X$ is a secure cryptographic
1195 The proposition is proved by contraposition. Assume that $X$ is not
1196 secure. By Definition, there exists a polynomial time probabilistic
1197 algorithm $D$, a positive polynomial $p$, such that for all $k_0$ there exists
1198 $N\geq \frac{k_0}{2}$ satisfying
1199 $$| \mathrm{Pr}[D(X(U_{2N}))=1]-\mathrm{Pr}[D(U_{kN}=1]|\geq \frac{1}{p(2N)}.$$
1200 We describe a new probabilistic algorithm $D^\prime$ on an input $w$ of size
1203 \item Decompose $w$ into $w=w_1\ldots w_{k}$, where each $w_i$ has size $N$.
1204 \item Pick a string $y$ of size $N$ uniformly at random.
1205 \item Compute $z=(y\oplus w_1)(y\oplus w_1\oplus w_2)\ldots (y
1206 \bigoplus_{i=1}^{i=k} w_i).$
1207 \item Return $D(z)$.
1211 Consider for each $y\in \mathbb{B}^{kN}$ the function $\varphi_{y}$
1212 from $\mathbb{B}^{kN}$ into $\mathbb{B}^{kN}$ mapping $w=w_1\ldots w_k$
1213 (each $w_i$ has length $N$) to
1214 $(y\oplus w_1)(y\oplus w_1\oplus w_2)\ldots (y
1215 \bigoplus_{i=1}^{i=k_1} w_i).$ By construction, one has for every $w$,
1216 \begin{equation}\label{PCH-1}
1217 D^\prime(w)=D(\varphi_y(w)),
1219 where $y$ is randomly generated.
1220 Moreover, for each $y$, $\varphi_{y}$ is injective: if
1221 $(y\oplus w_1)(y\oplus w_1\oplus w_2)\ldots (y\bigoplus_{i=1}^{i=k_1}
1222 w_i)=(y\oplus w_1^\prime)(y\oplus w_1^\prime\oplus w_2^\prime)\ldots
1223 (y\bigoplus_{i=1}^{i=k} w_i^\prime)$, then for every $1\leq j\leq k$,
1224 $y\bigoplus_{i=1}^{i=j} w_i^\prime=y\bigoplus_{i=1}^{i=j} w_i$. It follows,
1225 by a direct induction, that $w_i=w_i^\prime$. Furthermore, since $\mathbb{B}^{kN}$
1226 is finite, each $\varphi_y$ is bijective. Therefore, and using (\ref{PCH-1}),
1228 \begin{equation}\label{PCH-2}
1229 \mathrm{Pr}[D^\prime(U_{kN})=1]=\mathrm{Pr}[D(\varphi_y(U_{kN}))=1]=\mathrm{Pr}[D(U_{kN})=1].
1232 Now, using (\ref{PCH-1}) again, one has for every $x$,
1233 \begin{equation}\label{PCH-3}
1234 D^\prime(H(x))=D(\varphi_y(H(x))),
1236 where $y$ is randomly generated. By construction, $\varphi_y(H(x))=X(yx)$,
1238 \begin{equation}\label{PCH-3}
1239 D^\prime(H(x))=D(yx),
1241 where $y$ is randomly generated.
1244 \begin{equation}\label{PCH-4}
1245 \mathrm{Pr}[D^\prime(H(U_{N}))=1]=\mathrm{Pr}[D(U_{2N})=1].
1247 From (\ref{PCH-2}) and (\ref{PCH-4}), one can deduce that
1248 there exists a polynomial time probabilistic
1249 algorithm $D^\prime$, a positive polynomial $p$, such that for all $k_0$ there exists
1250 $N\geq \frac{k_0}{2}$ satisfying
1251 $$| \mathrm{Pr}[D(H(U_{N}))=1]-\mathrm{Pr}[D(U_{kN}=1]|\geq \frac{1}{p(2N)},$$
1252 proving that $H$ is not secure, which is a contradiction.
1256 \section{Cryptographical Applications}
1258 \subsection{A Cryptographically Secure PRNG for GPU}
1261 It is possible to build a cryptographically secure PRNG based on the previous
1262 algorithm (Algorithm~\ref{algo:gpu_kernel2}). Due to Proposition~\ref{cryptopreuve},
1263 it simply consists in replacing
1264 the {\it xor-like} PRNG by a cryptographically secure one.
1265 We have chosen the Blum Blum Shum generator~\cite{BBS} (usually denoted by BBS) having the form:
1266 $$x_{n+1}=x_n^2~ mod~ M$$ where $M$ is the product of two prime numbers (these
1267 prime numbers need to be congruent to 3 modulus 4). BBS is known to be
1268 very slow and only usable for cryptographic applications.
1271 The modulus operation is the most time consuming operation for current
1272 GPU cards. So in order to obtain quite reasonable performances, it is
1273 required to use only modulus on 32-bits integer numbers. Consequently
1274 $x_n^2$ need to be lesser than $2^{32}$, and thus the number $M$ must be
1275 lesser than $2^{16}$. So in practice we can choose prime numbers around
1276 256 that are congruent to 3 modulus 4. With 32-bits numbers, only the
1277 4 least significant bits of $x_n$ can be chosen (the maximum number of
1278 indistinguishable bits is lesser than or equals to
1279 $log_2(log_2(M))$). In other words, to generate a 32-bits number, we need to use
1280 8 times the BBS algorithm with possibly different combinations of $M$. This
1281 approach is not sufficient to be able to pass all the tests of TestU01,
1282 as small values of $M$ for the BBS lead to
1283 small periods. So, in order to add randomness we have proceeded with
1284 the followings modifications.
1287 Firstly, we define 16 arrangement arrays instead of 2 (as described in
1288 Algorithm \ref{algo:gpu_kernel2}), but only 2 of them are used at each call of
1289 the PRNG kernels. In practice, the selection of combination
1290 arrays to be used is different for all the threads. It is determined
1291 by using the three last bits of two internal variables used by BBS.
1292 %This approach adds more randomness.
1293 In Algorithm~\ref{algo:bbs_gpu},
1294 character \& is for the bitwise AND. Thus using \&7 with a number
1295 gives the last 3 bits, thus providing a number between 0 and 7.
1297 Secondly, after the generation of the 8 BBS numbers for each thread, we
1298 have a 32-bits number whose period is possibly quite small. So
1299 to add randomness, we generate 4 more BBS numbers to
1300 shift the 32-bits numbers, and add up to 6 new bits. This improvement is
1301 described in Algorithm~\ref{algo:bbs_gpu}. In practice, the last 2 bits
1302 of the first new BBS number are used to make a left shift of at most
1303 3 bits. The last 3 bits of the second new BBS number are added to the
1304 strategy whatever the value of the first left shift. The third and the
1305 fourth new BBS numbers are used similarly to apply a new left shift
1308 Finally, as we use 8 BBS numbers for each thread, the storage of these
1309 numbers at the end of the kernel is performed using a rotation. So,
1310 internal variable for BBS number 1 is stored in place 2, internal
1311 variable for BBS number 2 is stored in place 3, ..., and finally, internal
1312 variable for BBS number 8 is stored in place 1.
1317 \KwIn{InternalVarBBSArray: array with internal variables of the 8 BBS
1319 NumThreads: Number of threads\;
1320 array\_comb: 2D Arrays containing 16 combinations (in first dimension) of size combination\_size (in second dimension)\;
1321 array\_shift[4]=\{0,1,3,7\}\;
1324 \KwOut{NewNb: array containing random numbers in global memory}
1325 \If{threadId is concerned} {
1326 retrieve data from InternalVarBBSArray[threadId] in local variables including shared memory and x\;
1327 we consider that bbs1 ... bbs8 represent the internal states of the 8 BBS numbers\;
1328 offset = threadIdx\%combination\_size\;
1329 o1 = threadIdx-offset+array\_comb[bbs1\&7][offset]\;
1330 o2 = threadIdx-offset+array\_comb[8+bbs2\&7][offset]\;
1337 \tcp{two new shifts}
1338 shift=BBS3(bbs3)\&3\;
1340 t|=BBS1(bbs1)\&array\_shift[shift]\;
1341 shift=BBS7(bbs7)\&3\;
1343 t|=BBS2(bbs2)\&array\_shift[shift]\;
1344 t=t\textasciicircum shmem[o1]\textasciicircum shmem[o2]\;
1345 shared\_mem[threadId]=t\;
1346 x = x\textasciicircum t\;
1348 store the new PRNG in NewNb[NumThreads*threadId+i]\;
1350 store internal variables in InternalVarXorLikeArray[threadId] using a rotation\;
1353 \caption{main kernel for the BBS based PRNG GPU}
1354 \label{algo:bbs_gpu}
1357 In Algorithm~\ref{algo:bbs_gpu}, $n$ is for the quantity of random numbers that
1358 a thread has to generate. The operation t<<=4 performs a left shift of 4 bits
1359 on the variable $t$ and stores the result in $t$, and $BBS1(bbs1)\&15$ selects
1360 the last four bits of the result of $BBS1$. Thus an operation of the form
1361 $t<<=4; t|=BBS1(bbs1)\&15\;$ realizes in $t$ a left shift of 4 bits, and then
1362 puts the 4 last bits of $BBS1(bbs1)$ in the four last positions of $t$. Let us
1363 remark that the initialization $t$ is not a necessity as we fill it 4 bits by 4
1364 bits, until having obtained 32-bits. The two last new shifts are realized in
1365 order to enlarge the small periods of the BBS used here, to introduce a kind of
1366 variability. In these operations, we make twice a left shift of $t$ of \emph{at
1367 most} 3 bits, represented by \texttt{shift} in the algorithm, and we put
1368 \emph{exactly} the \texttt{shift} last bits from a BBS into the \texttt{shift}
1369 last bits of $t$. For this, an array named \texttt{array\_shift}, containing the
1370 correspondence between the shift and the number obtained with \texttt{shift} 1
1371 to make the \texttt{and} operation is used. For example, with a left shift of 0,
1372 we make an and operation with 0, with a left shift of 3, we make an and
1373 operation with 7 (represented by 111 in binary mode).
1375 It should be noticed that this generator has once more the form $x^{n+1} = x^n \oplus S^n$,
1376 where $S^n$ is referred in this algorithm as $t$: each iteration of this
1377 PRNG ends with $x = x \wedge t$. This $S^n$ is only constituted
1378 by secure bits produced by the BBS generator, and thus, due to
1379 Proposition~\ref{cryptopreuve}, the resulted PRNG is cryptographically
1384 \subsection{Toward a Cryptographically Secure and Chaotic Asymmetric Cryptosystem}
1385 \label{Blum-Goldwasser}
1386 We finish this research work by giving some thoughts about the use of
1387 the proposed PRNG in an asymmetric cryptosystem.
1388 This first approach will be further investigated in a future work.
1390 \subsubsection{Recalls of the Blum-Goldwasser Probabilistic Cryptosystem}
1392 The Blum-Goldwasser cryptosystem is a cryptographically secure asymmetric key encryption algorithm
1393 proposed in 1984~\cite{Blum:1985:EPP:19478.19501}. The encryption algorithm
1394 implements a XOR-based stream cipher using the BBS PRNG, in order to generate
1395 the keystream. Decryption is done by obtaining the initial seed thanks to
1396 the final state of the BBS generator and the secret key, thus leading to the
1397 reconstruction of the keystream.
1399 The key generation consists in generating two prime numbers $(p,q)$,
1400 randomly and independently of each other, that are
1401 congruent to 3 mod 4, and to compute the modulus $N=pq$.
1402 The public key is $N$, whereas the secret key is the factorization $(p,q)$.
1405 Suppose Bob wishes to send a string $m=(m_0, \dots, m_{L-1})$ of $L$ bits to Alice:
1407 \item Bob picks an integer $r$ randomly in the interval $\llbracket 1,N\rrbracket$ and computes $x_0 = r^2~mod~N$.
1408 \item He uses the BBS to generate the keystream of $L$ pseudorandom bits $(b_0, \dots, b_{L-1})$, as follows. For $i=0$ to $L-1$,
1411 \item While $i \leqslant L-1$:
1413 \item Set $b_i$ equal to the least-significant\footnote{As signaled previously, BBS can securely output up to $\mathsf{N} = \lfloor log(log(N)) \rfloor$ of the least-significant bits of $x_i$ during each round.} bit of $x_i$,
1415 \item $x_i = (x_{i-1})^2~mod~N.$
1418 \item The ciphertext is computed by XORing the plaintext bits $m$ with the keystream: $ c = (c_0, \dots, c_{L-1}) = m \oplus b$. This ciphertext is $[c, y]$, where $y=x_{0}^{2^{L}}~mod~N.$
1422 When Alice receives $\left[(c_0, \dots, c_{L-1}), y\right]$, she can recover $m$ as follows:
1424 \item Using the secret key $(p,q)$, she computes $r_p = y^{((p+1)/4)^{L}}~mod~p$ and $r_q = y^{((q+1)/4)^{L}}~mod~q$.
1425 \item The initial seed can be obtained using the following procedure: $x_0=q(q^{-1}~{mod}~p)r_p + p(p^{-1}~{mod}~q)r_q~{mod}~N$.
1426 \item She recomputes the bit-vector $b$ by using BBS and $x_0$.
1427 \item Alice finally computes the plaintext by XORing the keystream with the ciphertext: $ m = c \oplus b$.
1431 \subsubsection{Proposal of a new Asymmetric Cryptosystem Adapted from Blum-Goldwasser}
1433 We propose to adapt the Blum-Goldwasser protocol as follows.
1434 Let $\mathsf{N} = \lfloor log(log(N)) \rfloor$ be the number of bits that can
1435 be obtained securely with the BBS generator using the public key $N$ of Alice.
1436 Alice will pick randomly $S^0$ in $\llbracket 0, 2^{\mathsf{N}-1}\rrbracket$ too, and
1437 her new public key will be $(S^0, N)$.
1439 To encrypt his message, Bob will compute
1440 %%RAPH : ici, j'ai mis un simple $
1442 $c = \left(m_0 \oplus (b_0 \oplus S^0), m_1 \oplus (b_0 \oplus b_1 \oplus S^0), \hdots, \right.$
1443 $ \left. m_{L-1} \oplus (b_0 \oplus b_1 \hdots \oplus b_{L-1} \oplus S^0) \right)$
1445 instead of $\left(m_0 \oplus b_0, m_1 \oplus b_1, \hdots, m_{L-1} \oplus b_{L-1} \right)$.
1447 The same decryption stage as in Blum-Goldwasser leads to the sequence
1448 $\left(m_0 \oplus S^0, m_1 \oplus S^0, \hdots, m_{L-1} \oplus S^0 \right)$.
1449 Thus, with a simple use of $S^0$, Alice can obtain the plaintext.
1450 By doing so, the proposed generator is used in place of BBS, leading to
1451 the inheritance of all the properties presented in this paper.
1453 \section{Conclusion}
1456 In this paper, a formerly proposed PRNG based on chaotic iterations
1457 has been generalized to improve its speed. It has been proven to be
1458 chaotic according to Devaney.
1459 Efficient implementations on GPU using xor-like PRNGs as input generators
1460 have shown that a very large quantity of pseudorandom numbers can be generated per second (about
1461 20Gsamples/s), and that these proposed PRNGs succeed to pass the hardest battery in TestU01,
1462 namely the BigCrush.
1463 Furthermore, we have shown that when the inputted generator is cryptographically
1464 secure, then it is the case too for the PRNG we propose, thus leading to
1465 the possibility to develop fast and secure PRNGs using the GPU architecture.
1466 Thoughts about an improvement of the Blum-Goldwasser cryptosystem, using the
1467 proposed method, has been finally proposed.
1469 In future work we plan to extend these researches, building a parallel PRNG for clusters or
1470 grid computing. Topological properties of the various proposed generators will be investigated,
1471 and the use of other categories of PRNGs as input will be studied too. The improvement
1472 of Blum-Goldwasser will be deepened. Finally, we
1473 will try to enlarge the quantity of pseudorandom numbers generated per second either
1474 in a simulation context or in a cryptographic one.
1478 \bibliographystyle{plain}
1479 \bibliography{mabase}