1 %\documentclass{article}
2 \documentclass[10pt,journal,letterpaper,compsoc]{IEEEtran}
3 \usepackage[utf8]{inputenc}
4 \usepackage[T1]{fontenc}
11 \usepackage[ruled,vlined]{algorithm2e}
13 \usepackage[standard]{ntheorem}
15 % Pour mathds : les ensembles IR, IN, etc.
18 % Pour avoir des intervalles d'entiers
22 % Pour faire des sous-figures dans les figures
23 \usepackage{subfigure}
27 \newtheorem{notation}{Notation}
29 \newcommand{\X}{\mathcal{X}}
30 \newcommand{\Go}{G_{f_0}}
31 \newcommand{\B}{\mathds{B}}
32 \newcommand{\N}{\mathds{N}}
33 \newcommand{\BN}{\mathds{B}^\mathsf{N}}
36 \newcommand{\alert}[1]{\begin{color}{blue}\textit{#1}\end{color}}
38 \title{Efficient and Cryptographically Secure Generation of Chaotic Pseudorandom Numbers on GPU}
41 \author{Jacques M. Bahi, Rapha\"{e}l Couturier, Christophe
42 Guyeux, and Pierre-Cyrille Héam\thanks{Authors in alphabetic order}}
45 \IEEEcompsoctitleabstractindextext{
47 In this paper we present a new pseudorandom number generator (PRNG) on
48 graphics processing units (GPU). This PRNG is based on the so-called chaotic iterations. It
49 is firstly proven to be chaotic according to the Devaney's formulation. We thus propose an efficient
50 implementation for GPU that successfully passes the {\it BigCrush} tests, deemed to be the hardest
51 battery of tests in TestU01. Experiments show that this PRNG can generate
52 about 20 billion of random numbers per second on Tesla C1060 and NVidia GTX280
54 It is then established that, under reasonable assumptions, the proposed PRNG can be cryptographically
56 A chaotic version of the Blum-Goldwasser asymmetric key encryption scheme is finally proposed.
64 \IEEEdisplaynotcompsoctitleabstractindextext
65 \IEEEpeerreviewmaketitle
68 \section{Introduction}
70 Randomness is of importance in many fields such as scientific simulations or cryptography.
71 ``Random numbers'' can mainly be generated either by a deterministic and reproducible algorithm
72 called a pseudorandom number generator (PRNG), or by a physical non-deterministic
73 process having all the characteristics of a random noise, called a truly random number
75 In this paper, we focus on reproducible generators, useful for instance in
76 Monte-Carlo based simulators or in several cryptographic schemes.
77 These domains need PRNGs that are statistically irreproachable.
78 In some fields such as in numerical simulations, speed is a strong requirement
79 that is usually attained by using parallel architectures. In that case,
80 a recurrent problem is that a deflation of the statistical qualities is often
81 reported, when the parallelization of a good PRNG is realized.
82 This is why ad-hoc PRNGs for each possible architecture must be found to
83 achieve both speed and randomness.
84 On the other side, speed is not the main requirement in cryptography: the great
85 need is to define \emph{secure} generators able to withstand malicious
86 attacks. Roughly speaking, an attacker should not be able in practice to make
87 the distinction between numbers obtained with the secure generator and a true random
89 Finally, a small part of the community working in this domain focuses on a
90 third requirement, that is to define chaotic generators.
91 The main idea is to take benefits from a chaotic dynamical system to obtain a
92 generator that is unpredictable, disordered, sensible to its seed, or in other word chaotic.
93 Their desire is to map a given chaotic dynamics into a sequence that seems random
94 and unassailable due to chaos.
95 However, the chaotic maps used as a pattern are defined in the real line
96 whereas computers deal with finite precision numbers.
97 This distortion leads to a deflation of both chaotic properties and speed.
98 Furthermore, authors of such chaotic generators often claim their PRNG
99 as secure due to their chaos properties, but there is no obvious relation
100 between chaos and security as it is understood in cryptography.
101 This is why the use of chaos for PRNG still remains marginal and disputable.
103 The authors' opinion is that topological properties of disorder, as they are
104 properly defined in the mathematical theory of chaos, can reinforce the quality
105 of a PRNG. But they are not substitutable for security or statistical perfection.
106 Indeed, to the authors' mind, such properties can be useful in the two following situations. On the
107 one hand, a post-treatment based on a chaotic dynamical system can be applied
108 to a PRNG statistically deflective, in order to improve its statistical
109 properties. Such an improvement can be found, for instance, in~\cite{bgw09:ip,bcgr11:ip}.
110 On the other hand, chaos can be added to a fast, statistically perfect PRNG and/or a
111 cryptographically secure one, in case where chaos can be of interest,
112 \emph{only if these last properties are not lost during
113 the proposed post-treatment}. Such an assumption is behind this research work.
114 It leads to the attempts to define a
115 family of PRNGs that are chaotic while being fast and statistically perfect,
116 or cryptographically secure.
117 Let us finish this paragraph by noticing that, in this paper,
118 statistical perfection refers to the ability to pass the whole
119 {\it BigCrush} battery of tests, which is widely considered as the most
120 stringent statistical evaluation of a sequence claimed as random.
121 This battery can be found in the well-known TestU01 package~\cite{LEcuyerS07}.
122 Chaos, for its part, refers to the well-established definition of a
123 chaotic dynamical system proposed by Devaney~\cite{Devaney}.
126 In a previous work~\cite{bgw09:ip,guyeux10} we have proposed a post-treatment on PRNGs making them behave
127 as a chaotic dynamical system. Such a post-treatment leads to a new category of
128 PRNGs. We have shown that proofs of Devaney's chaos can be established for this
129 family, and that the sequence obtained after this post-treatment can pass the
130 NIST~\cite{Nist10}, DieHARD~\cite{Marsaglia1996}, and TestU01~\cite{LEcuyerS07} batteries of tests, even if the inputted generators
132 The proposition of this paper is to improve widely the speed of the formerly
133 proposed generator, without any lack of chaos or statistical properties.
134 In particular, a version of this PRNG on graphics processing units (GPU)
136 Although GPU was initially designed to accelerate
137 the manipulation of images, they are nowadays commonly used in many scientific
138 applications. Therefore, it is important to be able to generate pseudorandom
139 numbers inside a GPU when a scientific application runs in it. This remark
140 motivates our proposal of a chaotic and statistically perfect PRNG for GPU.
142 allows us to generate almost 20 billion of pseudorandom numbers per second.
143 Furthermore, we show that the proposed post-treatment preserves the
144 cryptographical security of the inputted PRNG, when this last has such a
146 Last, but not least, we propose a rewriting of the Blum-Goldwasser asymmetric
147 key encryption protocol by using the proposed method.
149 The remainder of this paper is organized as follows. In Section~\ref{section:related
150 works} we review some GPU implementations of PRNGs. Section~\ref{section:BASIC
151 RECALLS} gives some basic recalls on the well-known Devaney's formulation of chaos,
152 and on an iteration process called ``chaotic
153 iterations'' on which the post-treatment is based.
154 The proposed PRNG and its proof of chaos are given in Section~\ref{sec:pseudorandom}.
155 Section~\ref{sec:efficient PRNG} presents an efficient
156 implementation of this chaotic PRNG on a CPU, whereas Section~\ref{sec:efficient PRNG
157 gpu} describes and evaluates theoretically the GPU implementation.
158 Such generators are experimented in
159 Section~\ref{sec:experiments}.
160 We show in Section~\ref{sec:security analysis} that, if the inputted
161 generator is cryptographically secure, then it is the case too for the
162 generator provided by the post-treatment.
163 Such a proof leads to the proposition of a cryptographically secure and
164 chaotic generator on GPU based on the famous Blum Blum Shum
165 in Section~\ref{sec:CSGPU}, and to an improvement of the
166 Blum-Goldwasser protocol in Sect.~\ref{Blum-Goldwasser}.
167 This research work ends by a conclusion section, in which the contribution is
168 summarized and intended future work is presented.
173 \section{Related works on GPU based PRNGs}
174 \label{section:related works}
176 Numerous research works on defining GPU based PRNGs have already been proposed in the
177 literature, so that exhaustivity is impossible.
178 This is why authors of this document only give reference to the most significant attempts
179 in this domain, from their subjective point of view.
180 The quantity of pseudorandom numbers generated per second is mentioned here
181 only when the information is given in the related work.
182 A million numbers per second will be simply written as
183 1MSample/s whereas a billion numbers per second is 1GSample/s.
185 In \cite{Pang:2008:cec} a PRNG based on cellular automata is defined
186 with no requirement to an high precision integer arithmetic or to any bitwise
187 operations. Authors can generate about
188 3.2MSamples/s on a GeForce 7800 GTX GPU, which is quite an old card now.
189 However, there is neither a mention of statistical tests nor any proof of
190 chaos or cryptography in this document.
192 In \cite{ZRKB10}, the authors propose different versions of efficient GPU PRNGs
193 based on Lagged Fibonacci or Hybrid Taus. They have used these
194 PRNGs for Langevin simulations of biomolecules fully implemented on
195 GPU. Performances of the GPU versions are far better than those obtained with a
196 CPU, and these PRNGs succeed to pass the {\it BigCrush} battery of TestU01.
197 However the evaluations of the proposed PRNGs are only statistical ones.
200 Authors of~\cite{conf/fpga/ThomasHL09} have studied the implementation of some
201 PRNGs on different computing architectures: CPU, field-programmable gate array
202 (FPGA), massively parallel processors, and GPU. This study is of interest, because
203 the performance of the same PRNGs on different architectures are compared.
204 FPGA appears as the fastest and the most
205 efficient architecture, providing the fastest number of generated pseudorandom numbers
207 However, we notice that authors can ``only'' generate between 11 and 16GSamples/s
208 with a GTX 280 GPU, which should be compared with
209 the results presented in this document.
210 We can remark too that the PRNGs proposed in~\cite{conf/fpga/ThomasHL09} are only
211 able to pass the {\it Crush} battery, which is far easier than the {\it Big Crush} one.
213 Lastly, Cuda has developed a library for the generation of pseudorandom numbers called
214 Curand~\cite{curand11}. Several PRNGs are implemented, among
216 Xorwow~\cite{Marsaglia2003} and some variants of Sobol. The tests reported show that
217 their fastest version provides 15GSamples/s on the new Fermi C2050 card.
218 But their PRNGs cannot pass the whole TestU01 battery (only one test is failed).
221 We can finally remark that, to the best of our knowledge, no GPU implementation has been proven to be chaotic, and the cryptographically secure property has surprisingly never been considered.
223 \section{Basic Recalls}
224 \label{section:BASIC RECALLS}
226 This section is devoted to basic definitions and terminologies in the fields of
227 topological chaos and chaotic iterations. We assume the reader is familiar
228 with basic notions on topology (see for instance~\cite{Devaney}).
231 \subsection{Devaney's Chaotic Dynamical Systems}
233 In the sequel $S^{n}$ denotes the $n^{th}$ term of a sequence $S$ and $V_{i}$
234 denotes the $i^{th}$ component of a vector $V$. $f^{k}=f\circ ...\circ f$
235 is for the $k^{th}$ composition of a function $f$. Finally, the following
236 notation is used: $\llbracket1;N\rrbracket=\{1,2,\hdots,N\}$.
239 Consider a topological space $(\mathcal{X},\tau)$ and a continuous function $f :
240 \mathcal{X} \rightarrow \mathcal{X}$.
243 The function $f$ is said to be \emph{topologically transitive} if, for any pair of open sets
244 $U,V \subset \mathcal{X}$, there exists $k>0$ such that $f^k(U) \cap V \neq
249 An element $x$ is a \emph{periodic point} for $f$ of period $n\in \mathds{N}^*$
250 if $f^{n}(x)=x$.% The set of periodic points of $f$ is denoted $Per(f).$
254 $f$ is said to be \emph{regular} on $(\mathcal{X}, \tau)$ if the set of periodic
255 points for $f$ is dense in $\mathcal{X}$: for any point $x$ in $\mathcal{X}$,
256 any neighborhood of $x$ contains at least one periodic point (without
257 necessarily the same period).
261 \begin{definition}[Devaney's formulation of chaos~\cite{Devaney}]
262 The function $f$ is said to be \emph{chaotic} on $(\mathcal{X},\tau)$ if $f$ is regular and
263 topologically transitive.
266 The chaos property is strongly linked to the notion of ``sensitivity'', defined
267 on a metric space $(\mathcal{X},d)$ by:
270 \label{sensitivity} The function $f$ has \emph{sensitive dependence on initial conditions}
271 if there exists $\delta >0$ such that, for any $x\in \mathcal{X}$ and any
272 neighborhood $V$ of $x$, there exist $y\in V$ and $n > 0$ such that
273 $d\left(f^{n}(x), f^{n}(y)\right) >\delta $.
275 The constant $\delta$ is called the \emph{constant of sensitivity} of $f$.
278 Indeed, Banks \emph{et al.} have proven in~\cite{Banks92} that when $f$ is
279 chaotic and $(\mathcal{X}, d)$ is a metric space, then $f$ has the property of
280 sensitive dependence on initial conditions (this property was formerly an
281 element of the definition of chaos). To sum up, quoting Devaney
282 in~\cite{Devaney}, a chaotic dynamical system ``is unpredictable because of the
283 sensitive dependence on initial conditions. It cannot be broken down or
284 simplified into two subsystems which do not interact because of topological
285 transitivity. And in the midst of this random behavior, we nevertheless have an
286 element of regularity''. Fundamentally different behaviors are consequently
287 possible and occur in an unpredictable way.
291 \subsection{Chaotic Iterations}
292 \label{sec:chaotic iterations}
295 Let us consider a \emph{system} with a finite number $\mathsf{N} \in
296 \mathds{N}^*$ of elements (or \emph{cells}), so that each cell has a
297 Boolean \emph{state}. Having $\mathsf{N}$ Boolean values for these
298 cells leads to the definition of a particular \emph{state of the
299 system}. A sequence which elements belong to $\llbracket 1;\mathsf{N}
300 \rrbracket $ is called a \emph{strategy}. The set of all strategies is
301 denoted by $\llbracket 1, \mathsf{N} \rrbracket^\mathds{N}.$
304 \label{Def:chaotic iterations}
305 The set $\mathds{B}$ denoting $\{0,1\}$, let
306 $f:\mathds{B}^{\mathsf{N}}\longrightarrow \mathds{B}^{\mathsf{N}}$ be
307 a function and $S\in \llbracket 1, \mathsf{N} \rrbracket^\mathds{N}$ be a ``strategy''. The so-called
308 \emph{chaotic iterations} are defined by $x^0\in
309 \mathds{B}^{\mathsf{N}}$ and
311 \forall n\in \mathds{N}^{\ast }, \forall i\in
312 \llbracket1;\mathsf{N}\rrbracket ,x_i^n=\left\{
314 x_i^{n-1} & \text{ if }S^n\neq i \\
315 \left(f(x^{n-1})\right)_{S^n} & \text{ if }S^n=i.
320 In other words, at the $n^{th}$ iteration, only the $S^{n}-$th cell is
321 \textquotedblleft iterated\textquotedblright . Note that in a more
322 general formulation, $S^n$ can be a subset of components and
323 $\left(f(x^{n-1})\right)_{S^{n}}$ can be replaced by
324 $\left(f(x^{k})\right)_{S^{n}}$, where $k<n$, describing for example,
325 delays transmission~\cite{Robert1986,guyeux10}. Finally, let us remark that
326 the term ``chaotic'', in the name of these iterations, has \emph{a
327 priori} no link with the mathematical theory of chaos, presented above.
330 Let us now recall how to define a suitable metric space where chaotic iterations
331 are continuous. For further explanations, see, e.g., \cite{guyeux10}.
333 Let $\delta $ be the \emph{discrete Boolean metric}, $\delta
334 (x,y)=0\Leftrightarrow x=y.$ Given a function $f$, define the function
335 $F_{f}: \llbracket1;\mathsf{N}\rrbracket\times \mathds{B}^{\mathsf{N}}
336 \longrightarrow \mathds{B}^{\mathsf{N}}$
339 & (k,E) & \longmapsto & \left( E_{j}.\delta (k,j)+ f(E)_{k}.\overline{\delta
340 (k,j)}\right) _{j\in \llbracket1;\mathsf{N}\rrbracket}%
343 \noindent where + and . are the Boolean addition and product operations.
344 Consider the phase space:
346 \mathcal{X} = \llbracket 1 ; \mathsf{N} \rrbracket^\mathds{N} \times
347 \mathds{B}^\mathsf{N},
349 \noindent and the map defined on $\mathcal{X}$:
351 G_f\left(S,E\right) = \left(\sigma(S), F_f(i(S),E)\right), \label{Gf}
353 \noindent where $\sigma$ is the \emph{shift} function defined by $\sigma
354 (S^{n})_{n\in \mathds{N}}\in \llbracket 1, \mathsf{N} \rrbracket^\mathds{N}\longrightarrow (S^{n+1})_{n\in
355 \mathds{N}}\in \llbracket 1, \mathsf{N} \rrbracket^\mathds{N}$ and $i$ is the \emph{initial function}
356 $i:(S^{n})_{n\in \mathds{N}} \in \llbracket 1, \mathsf{N} \rrbracket^\mathds{N}\longrightarrow S^{0}\in \llbracket
357 1;\mathsf{N}\rrbracket$. Then the chaotic iterations proposed in
358 Definition \ref{Def:chaotic iterations} can be described by the following iterations:
362 X^0 \in \mathcal{X} \\
368 With this formulation, a shift function appears as a component of chaotic
369 iterations. The shift function is a famous example of a chaotic
370 map~\cite{Devaney} but its presence is not sufficient enough to claim $G_f$ as
372 To study this claim, a new distance between two points $X = (S,E), Y =
373 (\check{S},\check{E})\in
374 \mathcal{X}$ has been introduced in \cite{guyeux10} as follows:
376 d(X,Y)=d_{e}(E,\check{E})+d_{s}(S,\check{S}),
382 \displaystyle{d_{e}(E,\check{E})} & = & \displaystyle{\sum_{k=1}^{\mathsf{N}%
383 }\delta (E_{k},\check{E}_{k})}, \\
384 \displaystyle{d_{s}(S,\check{S})} & = & \displaystyle{\dfrac{9}{\mathsf{N}}%
385 \sum_{k=1}^{\infty }\dfrac{|S^k-\check{S}^k|}{10^{k}}}.%
391 This new distance has been introduced to satisfy the following requirements.
393 \item When the number of different cells between two systems is increasing, then
394 their distance should increase too.
395 \item In addition, if two systems present the same cells and their respective
396 strategies start with the same terms, then the distance between these two points
397 must be small because the evolution of the two systems will be the same for a
398 while. Indeed, both dynamical systems start with the same initial condition,
399 use the same update function, and as strategies are the same for a while, furthermore
400 updated components are the same as well.
402 The distance presented above follows these recommendations. Indeed, if the floor
403 value $\lfloor d(X,Y)\rfloor $ is equal to $n$, then the systems $E, \check{E}$
404 differ in $n$ cells ($d_e$ is indeed the Hamming distance). In addition, $d(X,Y) - \lfloor d(X,Y) \rfloor $ is a
405 measure of the differences between strategies $S$ and $\check{S}$. More
406 precisely, this floating part is less than $10^{-k}$ if and only if the first
407 $k$ terms of the two strategies are equal. Moreover, if the $k^{th}$ digit is
408 nonzero, then the $k^{th}$ terms of the two strategies are different.
409 The impact of this choice for a distance will be investigated at the end of the document.
411 Finally, it has been established in \cite{guyeux10} that,
414 Let $f$ be a map from $\mathds{B}^\mathsf{N}$ to itself. Then $G_{f}$ is continuous in
415 the metric space $(\mathcal{X},d)$.
418 The chaotic property of $G_f$ has been firstly established for the vectorial
419 Boolean negation $f(x_1,\hdots, x_\mathsf{N}) = (\overline{x_1},\hdots, \overline{x_\mathsf{N}})$ \cite{guyeux10}. To obtain a characterization, we have secondly
420 introduced the notion of asynchronous iteration graph recalled bellow.
422 Let $f$ be a map from $\mathds{B}^\mathsf{N}$ to itself. The
423 {\emph{asynchronous iteration graph}} associated with $f$ is the
424 directed graph $\Gamma(f)$ defined by: the set of vertices is
425 $\mathds{B}^\mathsf{N}$; for all $x\in\mathds{B}^\mathsf{N}$ and
426 $i\in \llbracket1;\mathsf{N}\rrbracket$,
427 the graph $\Gamma(f)$ contains an arc from $x$ to $F_f(i,x)$.
428 The relation between $\Gamma(f)$ and $G_f$ is clear: there exists a
429 path from $x$ to $x'$ in $\Gamma(f)$ if and only if there exists a
430 strategy $s$ such that the parallel iteration of $G_f$ from the
431 initial point $(s,x)$ reaches the point $x'$.
432 We have then proven in \cite{bcgr11:ip} that,
436 \label{Th:Caractérisation des IC chaotiques}
437 Let $f:\mathds{B}^\mathsf{N}\to\mathds{B}^\mathsf{N}$. $G_f$ is chaotic (according to Devaney)
438 if and only if $\Gamma(f)$ is strongly connected.
441 Finally, we have established in \cite{bcgr11:ip} that,
443 Let $f: \mathds{B}^{n} \rightarrow \mathds{B}^{n}$, $\Gamma(f)$ its
444 iteration graph, $\check{M}$ its adjacency
446 a $n\times n$ matrix defined by
448 M_{ij} = \frac{1}{n}\check{M}_{ij}$ %\textrm{
450 $M_{ii} = 1 - \frac{1}{n} \sum\limits_{j=1, j\neq i}^n \check{M}_{ij}$ otherwise.
452 If $\Gamma(f)$ is strongly connected, then
453 the output of the PRNG detailed in Algorithm~\ref{CI Algorithm} follows
454 a law that tends to the uniform distribution
455 if and only if $M$ is a double stochastic matrix.
459 These results of chaos and uniform distribution have led us to study the possibility of building a
460 pseudorandom number generator (PRNG) based on the chaotic iterations.
461 As $G_f$, defined on the domain $\llbracket 1 ; \mathsf{N} \rrbracket^{\mathds{N}}
462 \times \mathds{B}^\mathsf{N}$, is built from Boolean networks $f : \mathds{B}^\mathsf{N}
463 \rightarrow \mathds{B}^\mathsf{N}$, we can preserve the theoretical properties on $G_f$
464 during implementations (due to the discrete nature of $f$). Indeed, it is as if
465 $\mathds{B}^\mathsf{N}$ represents the memory of the computer whereas $\llbracket 1 ; \mathsf{N}
466 \rrbracket^{\mathds{N}}$ is its input stream (the seeds, for instance, in PRNG, or a physical noise in TRNG).
467 Let us finally remark that the vectorial negation satisfies the hypotheses of both theorems above.
469 \section{Application to Pseudorandomness}
470 \label{sec:pseudorandom}
472 \subsection{A First Pseudorandom Number Generator}
474 We have proposed in~\cite{bgw09:ip} a new family of generators that receives
475 two PRNGs as inputs. These two generators are mixed with chaotic iterations,
476 leading thus to a new PRNG that improves the statistical properties of each
477 generator taken alone. Furthermore, our generator
478 possesses various chaos properties that none of the generators used as input
482 \begin{algorithm}[h!]
484 \KwIn{a function $f$, an iteration number $b$, an initial configuration $x^0$
486 \KwOut{a configuration $x$ ($n$ bits)}
488 $k\leftarrow b + \textit{XORshift}(b)$\;
491 $s\leftarrow{\textit{XORshift}(n)}$\;
492 $x\leftarrow{F_f(s,x)}$\;
496 \caption{PRNG with chaotic functions}
503 \begin{algorithm}[h!]
505 \KwIn{the internal configuration $z$ (a 32-bit word)}
506 \KwOut{$y$ (a 32-bit word)}
507 $z\leftarrow{z\oplus{(z\ll13)}}$\;
508 $z\leftarrow{z\oplus{(z\gg17)}}$\;
509 $z\leftarrow{z\oplus{(z\ll5)}}$\;
513 \caption{An arbitrary round of \textit{XORshift} algorithm}
521 This generator is synthesized in Algorithm~\ref{CI Algorithm}.
522 It takes as input: a Boolean function $f$ satisfying Theorem~\ref{Th:Caractérisation des IC chaotiques};
523 an integer $b$, ensuring that the number of executed iterations is at least $b$
524 and at most $2b+1$; and an initial configuration $x^0$.
525 It returns the new generated configuration $x$. Internally, it embeds two
526 \textit{XORshift}$(k)$ PRNGs~\cite{Marsaglia2003} that return integers
527 uniformly distributed
528 into $\llbracket 1 ; k \rrbracket$.
529 \textit{XORshift} is a category of very fast PRNGs designed by George Marsaglia,
530 which repeatedly uses the transform of exclusive or (XOR, $\oplus$) on a number
531 with a bit shifted version of it. This PRNG, which has a period of
532 $2^{32}-1=4.29\times10^9$, is summed up in Algorithm~\ref{XORshift}. It is used
533 in our PRNG to compute the strategy length and the strategy elements.
535 This former generator has successively passed various batteries of statistical tests, as the NIST~\cite{bcgr11:ip}, DieHARD~\cite{Marsaglia1996}, and TestU01~\cite{LEcuyerS07} ones.
537 \subsection{Improving the Speed of the Former Generator}
539 Instead of updating only one cell at each iteration, we can try to choose a
540 subset of components and to update them together. Such an attempt leads
541 to a kind of merger of the two sequences used in Algorithm
542 \ref{CI Algorithm}. When the updating function is the vectorial negation,
543 this algorithm can be rewritten as follows:
548 x^0 \in \llbracket 0, 2^\mathsf{N}-1 \rrbracket, S \in \llbracket 0, 2^\mathsf{N}-1 \rrbracket^\mathds{N} \\
549 \forall n \in \mathds{N}^*, x^n = x^{n-1} \oplus S^n,
552 \label{equation Oplus}
554 where $\oplus$ is for the bitwise exclusive or between two integers.
555 This rewriting can be understood as follows. The $n-$th term $S^n$ of the
556 sequence $S$, which is an integer of $\mathsf{N}$ binary digits, presents
557 the list of cells to update in the state $x^n$ of the system (represented
558 as an integer having $\mathsf{N}$ bits too). More precisely, the $k-$th
559 component of this state (a binary digit) changes if and only if the $k-$th
560 digit in the binary decomposition of $S^n$ is 1.
562 The single basic component presented in Eq.~\ref{equation Oplus} is of
563 ordinary use as a good elementary brick in various PRNGs. It corresponds
564 to the following discrete dynamical system in chaotic iterations:
567 \forall n\in \mathds{N}^{\ast }, \forall i\in
568 \llbracket1;\mathsf{N}\rrbracket ,x_i^n=\left\{
570 x_i^{n-1} & \text{ if } i \notin \mathcal{S}^n \\
571 \left(f(x^{n-1})\right)_{S^n} & \text{ if }i \in \mathcal{S}^n.
575 where $f$ is the vectorial negation and $\forall n \in \mathds{N}$,
576 $\mathcal{S}^n \subset \llbracket 1, \mathsf{N} \rrbracket$ is such that
577 $k \in \mathcal{S}^n$ if and only if the $k-$th digit in the binary
578 decomposition of $S^n$ is 1. Such chaotic iterations are more general
579 than the ones presented in Definition \ref{Def:chaotic iterations} because, instead of updating only one term at each iteration,
580 we select a subset of components to change.
583 Obviously, replacing Algorithm~\ref{CI Algorithm} by
584 Equation~\ref{equation Oplus}, which is possible when the iteration function is
585 the vectorial negation, leads to a speed improvement. However, proofs
586 of chaos obtained in~\cite{bg10:ij} have been established
587 only for chaotic iterations of the form presented in Definition
588 \ref{Def:chaotic iterations}. The question is now to determine whether the
589 use of more general chaotic iterations to generate pseudorandom numbers
590 faster, does not deflate their topological chaos properties.
592 \subsection{Proofs of Chaos of the General Formulation of the Chaotic Iterations}
594 Let us consider the discrete dynamical systems in chaotic iterations having
595 the general form: $\forall n\in \mathds{N}^{\ast }$, $ \forall i\in
596 \llbracket1;\mathsf{N}\rrbracket $,
601 x_i^{n-1} & \text{ if } i \notin \mathcal{S}^n \\
602 \left(f(x^{n-1})\right)_{S^n} & \text{ if }i \in \mathcal{S}^n.
607 In other words, at the $n^{th}$ iteration, only the cells whose id is
608 contained into the set $S^{n}$ are iterated.
610 Let us now rewrite these general chaotic iterations as usual discrete dynamical
611 system of the form $X^{n+1}=f(X^n)$ on an ad hoc metric space. Such a formulation
612 is required in order to study the topological behavior of the system.
614 Let us introduce the following function:
617 \chi: & \llbracket 1; \mathsf{N} \rrbracket \times \mathcal{P}\left(\llbracket 1; \mathsf{N} \rrbracket\right) & \longrightarrow & \mathds{B}\\
618 & (i,X) & \longmapsto & \left\{ \begin{array}{ll} 0 & \textrm{if }i \notin X, \\ 1 & \textrm{if }i \in X, \end{array}\right.
621 where $\mathcal{P}\left(X\right)$ is for the powerset of the set $X$, that is, $Y \in \mathcal{P}\left(X\right) \Longleftrightarrow Y \subset X$.
623 Given a function $f:\mathds{B}^\mathsf{N} \longrightarrow \mathds{B}^\mathsf{N} $, define the function:
624 $F_{f}: \mathcal{P}\left(\llbracket1;\mathsf{N}\rrbracket \right) \times \mathds{B}^{\mathsf{N}}
625 \longrightarrow \mathds{B}^{\mathsf{N}}$
628 (P,E) & \longmapsto & \left( E_{j}.\chi (j,P)+f(E)_{j}.\overline{\chi(j,P)}\right) _{j\in \llbracket1;\mathsf{N}\rrbracket}%
631 where + and . are the Boolean addition and product operations, and $\overline{x}$
632 is the negation of the Boolean $x$.
633 Consider the phase space:
635 \mathcal{X} = \mathcal{P}\left(\llbracket 1 ; \mathsf{N} \rrbracket\right)^\mathds{N} \times
636 \mathds{B}^\mathsf{N},
638 \noindent and the map defined on $\mathcal{X}$:
640 G_f\left(S,E\right) = \left(\sigma(S), F_f(i(S),E)\right), %\label{Gf} %%RAPH, j'ai viré ce label qui existe déjà avant...
642 \noindent where $\sigma$ is the \emph{shift} function defined by $\sigma
643 (S^{n})_{n\in \mathds{N}}\in \mathcal{P}\left(\llbracket 1 ; \mathsf{N} \rrbracket\right)^\mathds{N}\longrightarrow (S^{n+1})_{n\in
644 \mathds{N}}\in \mathcal{P}\left(\llbracket 1 ; \mathsf{N} \rrbracket\right)^\mathds{N}$ and $i$ is the \emph{initial function}
645 $i:(S^{n})_{n\in \mathds{N}} \in \mathcal{P}\left(\llbracket 1 ; \mathsf{N} \rrbracket\right)^\mathds{N}\longrightarrow S^{0}\in \mathcal{P}\left(\llbracket 1 ; \mathsf{N} \rrbracket\right)$.
646 Then the general chaotic iterations defined in Equation \ref{general CIs} can
647 be described by the following discrete dynamical system:
651 X^0 \in \mathcal{X} \\
657 Once more, a shift function appears as a component of these general chaotic
660 To study the Devaney's chaos property, a distance between two points
661 $X = (S,E), Y = (\check{S},\check{E})$ of $\mathcal{X}$ must be defined.
664 d(X,Y)=d_{e}(E,\check{E})+d_{s}(S,\check{S}),
667 \noindent where $ \displaystyle{d_{e}(E,\check{E})} = \displaystyle{\sum_{k=1}^{\mathsf{N}%
668 }\delta (E_{k},\check{E}_{k})}$ is once more the Hamming distance, and
669 $ \displaystyle{d_{s}(S,\check{S})} = \displaystyle{\dfrac{9}{\mathsf{N}}%
670 \sum_{k=1}^{\infty }\dfrac{|S^k\Delta {S}^k|}{10^{k}}}$,
671 %%RAPH : ici, j'ai supprimé tous les sauts à la ligne
674 %% \begin{array}{lll}
675 %% \displaystyle{d_{e}(E,\check{E})} & = & \displaystyle{\sum_{k=1}^{\mathsf{N}%
676 %% }\delta (E_{k},\check{E}_{k})} \textrm{ is once more the Hamming distance}, \\
677 %% \displaystyle{d_{s}(S,\check{S})} & = & \displaystyle{\dfrac{9}{\mathsf{N}}%
678 %% \sum_{k=1}^{\infty }\dfrac{|S^k\Delta {S}^k|}{10^{k}}}.%
682 where $|X|$ is the cardinality of a set $X$ and $A\Delta B$ is for the symmetric difference, defined for sets A, B as
683 $A\,\Delta\,B = (A \setminus B) \cup (B \setminus A)$.
687 The function $d$ defined in Eq.~\ref{nouveau d} is a metric on $\mathcal{X}$.
691 $d_e$ is the Hamming distance. We will prove that $d_s$ is a distance
692 too, thus $d$, as being the sum of two distances, will also be a distance.
694 \item Obviously, $d_s(S,\check{S})\geqslant 0$, and if $S=\check{S}$, then
695 $d_s(S,\check{S})=0$. Conversely, if $d_s(S,\check{S})=0$, then
696 $\forall k \in \mathds{N}, |S^k\Delta {S}^k|=0$, and so $\forall k, S^k=\check{S}^k$.
697 \item $d_s$ is symmetric
698 ($d_s(S,\check{S})=d_s(\check{S},S)$) due to the commutative property
699 of the symmetric difference.
700 \item Finally, $|S \Delta S''| = |(S \Delta \varnothing) \Delta S''|= |S \Delta (S'\Delta S') \Delta S''|= |(S \Delta S') \Delta (S' \Delta S'')|\leqslant |S \Delta S'| + |S' \Delta S''|$,
701 and so for all subsets $S,S',$ and $S''$ of $\llbracket 1, \mathsf{N} \rrbracket$,
702 we have $d_s(S,S'') \leqslant d_e(S,S')+d_s(S',S'')$, and the triangle
703 inequality is obtained.
708 Before being able to study the topological behavior of the general
709 chaotic iterations, we must first establish that:
712 For all $f:\mathds{B}^\mathsf{N} \longrightarrow \mathds{B}^\mathsf{N} $, the function $G_f$ is continuous on
713 $\left( \mathcal{X},d\right)$.
718 We use the sequential continuity.
719 Let $(S^n,E^n)_{n\in \mathds{N}}$ be a sequence of the phase space $%
720 \mathcal{X}$, which converges to $(S,E)$. We will prove that $\left(
721 G_{f}(S^n,E^n)\right) _{n\in \mathds{N}}$ converges to $\left(
722 G_{f}(S,E)\right) $. Let us remark that for all $n$, $S^n$ is a strategy,
723 thus, we consider a sequence of strategies (\emph{i.e.}, a sequence of
725 As $d((S^n,E^n);(S,E))$ converges to 0, each distance $d_{e}(E^n,E)$ and $d_{s}(S^n,S)$ converges
726 to 0. But $d_{e}(E^n,E)$ is an integer, so $\exists n_{0}\in \mathds{N},$ $%
727 d_{e}(E^n,E)=0$ for any $n\geqslant n_{0}$.\newline
728 In other words, there exists a threshold $n_{0}\in \mathds{N}$ after which no
729 cell will change its state:
730 $\exists n_{0}\in \mathds{N},n\geqslant n_{0}\Rightarrow E^n = E.$
732 In addition, $d_{s}(S^n,S)\longrightarrow 0,$ so $\exists n_{1}\in %
733 \mathds{N},d_{s}(S^n,S)<10^{-1}$ for all indexes greater than or equal to $%
734 n_{1}$. This means that for $n\geqslant n_{1}$, all the $S^n$ have the same
735 first term, which is $S^0$: $\forall n\geqslant n_{1},S_0^n=S_0.$
737 Thus, after the $max(n_{0},n_{1})^{th}$ term, states of $E^n$ and $E$ are
738 identical and strategies $S^n$ and $S$ start with the same first term.\newline
739 Consequently, states of $G_{f}(S^n,E^n)$ and $G_{f}(S,E)$ are equal,
740 so, after the $max(n_0, n_1)^{th}$ term, the distance $d$ between these two points is strictly less than 1.\newline
741 \noindent We now prove that the distance between $\left(
742 G_{f}(S^n,E^n)\right) $ and $\left( G_{f}(S,E)\right) $ is convergent to
743 0. Let $\varepsilon >0$. \medskip
745 \item If $\varepsilon \geqslant 1$, we see that the distance
746 between $\left( G_{f}(S^n,E^n)\right) $ and $\left( G_{f}(S,E)\right) $ is
747 strictly less than 1 after the $max(n_{0},n_{1})^{th}$ term (same state).
749 \item If $\varepsilon <1$, then $\exists k\in \mathds{N},10^{-k}\geqslant
750 \varepsilon > 10^{-(k+1)}$. But $d_{s}(S^n,S)$ converges to 0, so
752 \exists n_{2}\in \mathds{N},\forall n\geqslant
753 n_{2},d_{s}(S^n,S)<10^{-(k+2)},
755 thus after $n_{2}$, the $k+2$ first terms of $S^n$ and $S$ are equal.
757 \noindent As a consequence, the $k+1$ first entries of the strategies of $%
758 G_{f}(S^n,E^n)$ and $G_{f}(S,E)$ are the same ($G_{f}$ is a shift of strategies) and due to the definition of $d_{s}$, the floating part of
759 the distance between $(S^n,E^n)$ and $(S,E)$ is strictly less than $%
760 10^{-(k+1)}\leqslant \varepsilon $.
763 %%RAPH : ici j'ai rajouté une ligne
765 \forall \varepsilon >0,$ $\exists N_{0}=max(n_{0},n_{1},n_{2})\in \mathds{N}
766 ,$ $\forall n\geqslant N_{0},$
767 $ d\left( G_{f}(S^n,E^n);G_{f}(S,E)\right)
768 \leqslant \varepsilon .
770 $G_{f}$ is consequently continuous.
774 It is now possible to study the topological behavior of the general chaotic
775 iterations. We will prove that,
778 \label{t:chaos des general}
779 The general chaotic iterations defined on Equation~\ref{general CIs} satisfy
780 the Devaney's property of chaos.
783 Let us firstly prove the following lemma.
785 \begin{lemma}[Strong transitivity]
787 For all couples $X,Y \in \mathcal{X}$ and any neighborhood $V$ of $X$, we can
788 find $n \in \mathds{N}^*$ and $X' \in V$ such that $G^n(X')=Y$.
792 Let $X=(S,E)$, $\varepsilon>0$, and $k_0 = \lfloor log_{10}(\varepsilon)+1 \rfloor$.
793 Any point $X'=(S',E')$ such that $E'=E$ and $\forall k \leqslant k_0, S'^k=S^k$,
794 are in the open ball $\mathcal{B}\left(X,\varepsilon\right)$. Let us define
795 $\check{X} = \left(\check{S},\check{E}\right)$, where $\check{X}= G^{k_0}(X)$.
796 We denote by $s\subset \llbracket 1; \mathsf{N} \rrbracket$ the set of coordinates
797 that are different between $\check{E}$ and the state of $Y$. Thus each point $X'$ of
798 the form $(S',E')$ where $E'=E$ and $S'$ starts with
799 $(S^0, S^1, \hdots, S^{k_0},s,\hdots)$, verifies the following properties:
801 \item $X'$ is in $\mathcal{B}\left(X,\varepsilon\right)$,
802 \item the state of $G_f^{k_0+1}(X')$ is the state of $Y$.
804 Finally the point $\left(\left(S^0, S^1, \hdots, S^{k_0},s,s^0, s^1, \hdots\right); E\right)$,
805 where $(s^0,s^1, \hdots)$ is the strategy of $Y$, satisfies the properties
806 claimed in the lemma.
809 We can now prove the Theorem~\ref{t:chaos des general}.
811 \begin{proof}[Theorem~\ref{t:chaos des general}]
812 Firstly, strong transitivity implies transitivity.
814 Let $(S,E) \in\mathcal{X}$ and $\varepsilon >0$. To
815 prove that $G_f$ is regular, it is sufficient to prove that
816 there exists a strategy $\tilde S$ such that the distance between
817 $(\tilde S,E)$ and $(S,E)$ is less than $\varepsilon$, and such that
818 $(\tilde S,E)$ is a periodic point.
820 Let $t_1=\lfloor-\log_{10}(\varepsilon)\rfloor$, and let $E'$ be the
821 configuration that we obtain from $(S,E)$ after $t_1$ iterations of
822 $G_f$. As $G_f$ is strongly transitive, there exists a strategy $S'$
823 and $t_2\in\mathds{N}$ such
824 that $E$ is reached from $(S',E')$ after $t_2$ iterations of $G_f$.
826 Consider the strategy $\tilde S$ that alternates the first $t_1$ terms
827 of $S$ and the first $t_2$ terms of $S'$:
828 %%RAPH : j'ai coupé la ligne en 2
830 S=(S_0,\dots,S_{t_1-1},S'_0,\dots,S'_{t_2-1},S_0,$$$$\dots,S_{t_1-1},S'_0,\dots,S'_{t_2-1},S_0,\dots).$$ It
831 is clear that $(\tilde S,E)$ is obtained from $(\tilde S,E)$ after
832 $t_1+t_2$ iterations of $G_f$. So $(\tilde S,E)$ is a periodic
833 point. Since $\tilde S_t=S_t$ for $t<t_1$, by the choice of $t_1$, we
834 have $d((S,E),(\tilde S,E))<\epsilon$.
839 \section{Efficient PRNG based on Chaotic Iterations}
840 \label{sec:efficient PRNG}
842 Based on the proof presented in the previous section, it is now possible to
843 improve the speed of the generator formerly presented in~\cite{bgw09:ip,guyeux10}.
844 The first idea is to consider
845 that the provided strategy is a pseudorandom Boolean vector obtained by a
847 An iteration of the system is simply the bitwise exclusive or between
848 the last computed state and the current strategy.
849 Topological properties of disorder exhibited by chaotic
850 iterations can be inherited by the inputted generator, we hope by doing so to
851 obtain some statistical improvements while preserving speed.
853 %%RAPH : j'ai viré tout ca
854 %% Let us give an example using 16-bits numbers, to clearly understand how the bitwise xor operations
857 %% Suppose that $x$ and the strategy $S^i$ are given as
859 %% Table~\ref{TableExemple} shows the result of $x \oplus S^i$.
862 %% \begin{scriptsize}
864 %% \begin{array}{|cc|cccccccccccccccc|}
866 %% x &=&1&0&1&1&1&0&1&0&1&0&0&1&0&0&1&0\\
868 %% S^i &=&0&1&1&0&0&1&1&0&1&1&1&0&0&1&1&1\\
870 %% x \oplus S^i&=&1&1&0&1&1&1&0&0&0&1&1&1&0&1&0&1\\
877 %% \caption{Example of an arbitrary round of the proposed generator}
878 %% \label{TableExemple}
884 \lstset{language=C,caption={C code of the sequential PRNG based on chaotic iterations},label=algo:seqCIPRNG}
888 unsigned int CIPRNG() {
889 static unsigned int x = 123123123;
890 unsigned long t1 = xorshift();
891 unsigned long t2 = xor128();
892 unsigned long t3 = xorwow();
893 x = x^(unsigned int)t1;
894 x = x^(unsigned int)(t2>>32);
895 x = x^(unsigned int)(t3>>32);
896 x = x^(unsigned int)t2;
897 x = x^(unsigned int)(t1>>32);
898 x = x^(unsigned int)t3;
906 In Listing~\ref{algo:seqCIPRNG} a sequential version of the proposed PRNG based
907 on chaotic iterations is presented. The xor operator is represented by
908 \textasciicircum. This function uses three classical 64-bits PRNGs, namely the
909 \texttt{xorshift}, the \texttt{xor128}, and the
910 \texttt{xorwow}~\cite{Marsaglia2003}. In the following, we call them ``xor-like
911 PRNGs''. As each xor-like PRNG uses 64-bits whereas our proposed generator
912 works with 32-bits, we use the command \texttt{(unsigned int)}, that selects the
913 32 least significant bits of a given integer, and the code \texttt{(unsigned
914 int)(t$>>$32)} in order to obtain the 32 most significant bits of \texttt{t}.
916 Thus producing a pseudorandom number needs 6 xor operations with 6 32-bits numbers
917 that are provided by 3 64-bits PRNGs. This version successfully passes the
918 stringent BigCrush battery of tests~\cite{LEcuyerS07}.
920 \section{Efficient PRNGs based on Chaotic Iterations on GPU}
921 \label{sec:efficient PRNG gpu}
923 In order to take benefits from the computing power of GPU, a program
924 needs to have independent blocks of threads that can be computed
925 simultaneously. In general, the larger the number of threads is, the
926 more local memory is used, and the less branching instructions are
927 used (if, while, ...), the better the performances on GPU is.
928 Obviously, having these requirements in mind, it is possible to build
929 a program similar to the one presented in Listing
930 \ref{algo:seqCIPRNG}, which computes pseudorandom numbers on GPU. To
931 do so, we must firstly recall that in the CUDA~\cite{Nvid10}
932 environment, threads have a local identifier called
933 \texttt{ThreadIdx}, which is relative to the block containing
934 them. Furthermore, in CUDA, parts of the code that are executed by the GPU, are
935 called {\it kernels}.
938 \subsection{Naive Version for GPU}
941 It is possible to deduce from the CPU version a quite similar version adapted to GPU.
942 The simple principle consists in making each thread of the GPU computing the CPU version of our PRNG.
943 Of course, the three xor-like
944 PRNGs used in these computations must have different parameters.
945 In a given thread, these parameters are
946 randomly picked from another PRNGs.
947 The initialization stage is performed by the CPU.
948 To do it, the ISAAC PRNG~\cite{Jenkins96} is used to set all the
949 parameters embedded into each thread.
951 The implementation of the three
952 xor-like PRNGs is straightforward when their parameters have been
953 allocated in the GPU memory. Each xor-like works with an internal
954 number $x$ that saves the last generated pseudorandom number. Additionally, the
955 implementation of the xor128, the xorshift, and the xorwow respectively require
956 4, 5, and 6 unsigned long as internal variables.
961 \KwIn{InternalVarXorLikeArray: array with internal variables of the 3 xor-like
962 PRNGs in global memory\;
963 NumThreads: number of threads\;}
964 \KwOut{NewNb: array containing random numbers in global memory}
965 \If{threadIdx is concerned by the computation} {
966 retrieve data from InternalVarXorLikeArray[threadIdx] in local variables\;
968 compute a new PRNG as in Listing\ref{algo:seqCIPRNG}\;
969 store the new PRNG in NewNb[NumThreads*threadIdx+i]\;
971 store internal variables in InternalVarXorLikeArray[threadIdx]\;
974 \caption{Main kernel of the GPU ``naive'' version of the PRNG based on chaotic iterations}
975 \label{algo:gpu_kernel}
980 Algorithm~\ref{algo:gpu_kernel} presents a naive implementation of the proposed PRNG on
981 GPU. Due to the available memory in the GPU and the number of threads
982 used simultaneously, the number of random numbers that a thread can generate
983 inside a kernel is limited (\emph{i.e.}, the variable \texttt{n} in
984 algorithm~\ref{algo:gpu_kernel}). For instance, if $100,000$ threads are used and
985 if $n=100$\footnote{in fact, we need to add the initial seed (a 32-bits number)},
986 then the memory required to store all of the internals variables of both the xor-like
987 PRNGs\footnote{we multiply this number by $2$ in order to count 32-bits numbers}
988 and the pseudorandom numbers generated by our PRNG, is equal to $100,000\times ((4+5+6)\times
989 2+(1+100))=1,310,000$ 32-bits numbers, that is, approximately $52$Mb.
991 This generator is able to pass the whole BigCrush battery of tests, for all
992 the versions that have been tested depending on their number of threads
993 (called \texttt{NumThreads} in our algorithm, tested up to $5$ million).
996 The proposed algorithm has the advantage of manipulating independent
997 PRNGs, so this version is easily adaptable on a cluster of computers too. The only thing
998 to ensure is to use a single ISAAC PRNG. To achieve this requirement, a simple solution consists in
999 using a master node for the initialization. This master node computes the initial parameters
1000 for all the different nodes involved in the computation.
1003 \subsection{Improved Version for GPU}
1005 As GPU cards using CUDA have shared memory between threads of the same block, it
1006 is possible to use this feature in order to simplify the previous algorithm,
1007 i.e., to use less than 3 xor-like PRNGs. The solution consists in computing only
1008 one xor-like PRNG by thread, saving it into the shared memory, and then to use the results
1009 of some other threads in the same block of threads. In order to define which
1010 thread uses the result of which other one, we can use a combination array that
1011 contains the indexes of all threads and for which a combination has been
1014 In Algorithm~\ref{algo:gpu_kernel2}, two combination arrays are used. The
1015 variable \texttt{offset} is computed using the value of
1016 \texttt{combination\_size}. Then we can compute \texttt{o1} and \texttt{o2}
1017 representing the indexes of the other threads whose results are used by the
1018 current one. In this algorithm, we consider that a 32-bits xor-like PRNG has
1019 been chosen. In practice, we use the xor128 proposed in~\cite{Marsaglia2003} in
1020 which unsigned longs (64 bits) have been replaced by unsigned integers (32
1023 This version can also pass the whole {\it BigCrush} battery of tests.
1027 \KwIn{InternalVarXorLikeArray: array with internal variables of 1 xor-like PRNGs
1029 NumThreads: Number of threads\;
1030 array\_comb1, array\_comb2: Arrays containing combinations of size combination\_size\;}
1032 \KwOut{NewNb: array containing random numbers in global memory}
1033 \If{threadId is concerned} {
1034 retrieve data from InternalVarXorLikeArray[threadId] in local variables including shared memory and x\;
1035 offset = threadIdx\%combination\_size\;
1036 o1 = threadIdx-offset+array\_comb1[offset]\;
1037 o2 = threadIdx-offset+array\_comb2[offset]\;
1040 t=t\textasciicircum shmem[o1]\textasciicircum shmem[o2]\;
1041 shared\_mem[threadId]=t\;
1042 x = x\textasciicircum t\;
1044 store the new PRNG in NewNb[NumThreads*threadId+i]\;
1046 store internal variables in InternalVarXorLikeArray[threadId]\;
1049 \caption{Main kernel for the chaotic iterations based PRNG GPU efficient
1051 \label{algo:gpu_kernel2}
1054 \subsection{Theoretical Evaluation of the Improved Version}
1056 A run of Algorithm~\ref{algo:gpu_kernel2} consists in an operation ($x=x\oplus t$) having
1057 the form of Equation~\ref{equation Oplus}, which is equivalent to the iterative
1058 system of Eq.~\ref{eq:generalIC}. That is, an iteration of the general chaotic
1059 iterations is realized between the last stored value $x$ of the thread and a strategy $t$
1060 (obtained by a bitwise exclusive or between a value provided by a xor-like() call
1061 and two values previously obtained by two other threads).
1062 To be certain that we are in the framework of Theorem~\ref{t:chaos des general},
1063 we must guarantee that this dynamical system iterates on the space
1064 $\mathcal{X} = \mathcal{P}\left(\llbracket 1, \mathsf{N} \rrbracket\right)^\mathds{N}\times\mathds{B}^\mathsf{N}$.
1065 The left term $x$ obviously belongs to $\mathds{B}^ \mathsf{N}$.
1066 To prevent from any flaws of chaotic properties, we must check that the right
1067 term (the last $t$), corresponding to the strategies, can possibly be equal to any
1068 integer of $\llbracket 1, \mathsf{N} \rrbracket$.
1070 Such a result is obvious, as for the xor-like(), all the
1071 integers belonging into its interval of definition can occur at each iteration, and thus the
1072 last $t$ respects the requirement. Furthermore, it is possible to
1073 prove by an immediate mathematical induction that, as the initial $x$
1074 is uniformly distributed (it is provided by a cryptographically secure PRNG),
1075 the two other stored values shmem[o1] and shmem[o2] are uniformly distributed too,
1076 (this is the induction hypothesis), and thus the next $x$ is finally uniformly distributed.
1078 Thus Algorithm~\ref{algo:gpu_kernel2} is a concrete realization of the general
1079 chaotic iterations presented previously, and for this reason, it satisfies the
1080 Devaney's formulation of a chaotic behavior.
1082 \section{Experiments}
1083 \label{sec:experiments}
1085 Different experiments have been performed in order to measure the generation
1086 speed. We have used a first computer equipped with a Tesla C1060 NVidia GPU card
1088 Intel Xeon E5530 cadenced at 2.40 GHz, and
1089 a second computer equipped with a smaller CPU and a GeForce GTX 280.
1091 cards have 240 cores.
1093 In Figure~\ref{fig:time_xorlike_gpu} we compare the quantity of pseudorandom numbers
1094 generated per second with various xor-like based PRNGs. In this figure, the optimized
1095 versions use the {\it xor64} described in~\cite{Marsaglia2003}, whereas the naive versions
1096 embed the three xor-like PRNGs described in Listing~\ref{algo:seqCIPRNG}. In
1097 order to obtain the optimal performances, the storage of pseudorandom numbers
1098 into the GPU memory has been removed. This step is time consuming and slows down the numbers
1099 generation. Moreover this storage is completely
1100 useless, in case of applications that consume the pseudorandom
1101 numbers directly after generation. We can see that when the number of threads is greater
1102 than approximately 30,000 and lower than 5 million, the number of pseudorandom numbers generated
1103 per second is almost constant. With the naive version, this value ranges from 2.5 to
1104 3GSamples/s. With the optimized version, it is approximately equal to
1105 20GSamples/s. Finally we can remark that both GPU cards are quite similar, but in
1106 practice, the Tesla C1060 has more memory than the GTX 280, and this memory
1107 should be of better quality.
1108 As a comparison, Listing~\ref{algo:seqCIPRNG} leads to the generation of about
1109 138MSample/s when using one core of the Xeon E5530.
1111 \begin{figure}[htbp]
1113 \includegraphics[width=\columnwidth]{curve_time_xorlike_gpu.pdf}
1115 \caption{Quantity of pseudorandom numbers generated per second with the xorlike-based PRNG}
1116 \label{fig:time_xorlike_gpu}
1123 In Figure~\ref{fig:time_bbs_gpu} we highlight the performances of the optimized
1124 BBS-based PRNG on GPU. On the Tesla C1060 we obtain approximately 700MSample/s
1125 and on the GTX 280 about 670MSample/s, which is obviously slower than the
1126 xorlike-based PRNG on GPU. However, we will show in the next sections that this
1127 new PRNG has a strong level of security, which is necessarily paid by a speed
1130 \begin{figure}[htbp]
1132 \includegraphics[width=\columnwidth]{curve_time_bbs_gpu.pdf}
1134 \caption{Quantity of pseudorandom numbers generated per second using the BBS-based PRNG}
1135 \label{fig:time_bbs_gpu}
1138 All these experiments allow us to conclude that it is possible to
1139 generate a very large quantity of pseudorandom numbers statistically perfect with the xor-like version.
1140 To a certain extend, it is also the case with the secure BBS-based version, the speed deflation being
1141 explained by the fact that the former version has ``only''
1142 chaotic properties and statistical perfection, whereas the latter is also cryptographically secure,
1143 as it is shown in the next sections.
1151 \section{Security Analysis}
1152 \label{sec:security analysis}
1156 In this section the concatenation of two strings $u$ and $v$ is classically
1158 In a cryptographic context, a pseudorandom generator is a deterministic
1159 algorithm $G$ transforming strings into strings and such that, for any
1160 seed $s$ of length $m$, $G(s)$ (the output of $G$ on the input $s$) has size
1161 $\ell_G(m)$ with $\ell_G(m)>m$.
1162 The notion of {\it secure} PRNGs can now be defined as follows.
1165 A cryptographic PRNG $G$ is secure if for any probabilistic polynomial time
1166 algorithm $D$, for any positive polynomial $p$, and for all sufficiently
1168 $$| \mathrm{Pr}[D(G(U_m))=1]-Pr[D(U_{\ell_G(m)})=1]|< \frac{1}{p(m)},$$
1169 where $U_r$ is the uniform distribution over $\{0,1\}^r$ and the
1170 probabilities are taken over $U_m$, $U_{\ell_G(m)}$ as well as over the
1171 internal coin tosses of $D$.
1174 Intuitively, it means that there is no polynomial time algorithm that can
1175 distinguish a perfect uniform random generator from $G$ with a non
1176 negligible probability. The interested reader is referred
1177 to~\cite[chapter~3]{Goldreich} for more information. Note that it is
1178 quite easily possible to change the function $\ell$ into any polynomial
1179 function $\ell^\prime$ satisfying $\ell^\prime(m)>m)$~\cite[Chapter 3.3]{Goldreich}.
1181 The generation schema developed in (\ref{equation Oplus}) is based on a
1182 pseudorandom generator. Let $H$ be a cryptographic PRNG. We may assume,
1183 without loss of generality, that for any string $S_0$ of size $N$, the size
1184 of $H(S_0)$ is $kN$, with $k>2$. It means that $\ell_H(N)=kN$.
1185 Let $S_1,\ldots,S_k$ be the
1186 strings of length $N$ such that $H(S_0)=S_1 \ldots S_k$ ($H(S_0)$ is the concatenation of
1187 the $S_i$'s). The cryptographic PRNG $X$ defined in (\ref{equation Oplus})
1188 is the algorithm mapping any string of length $2N$ $x_0S_0$ into the string
1189 $(x_0\oplus S_0 \oplus S_1)(x_0\oplus S_0 \oplus S_1\oplus S_2)\ldots
1190 (x_o\bigoplus_{i=0}^{i=k}S_i)$. One in particular has $\ell_{X}(2N)=kN=\ell_H(N)$.
1191 We claim now that if this PRNG is secure,
1192 then the new one is secure too.
1195 \label{cryptopreuve}
1196 If $H$ is a secure cryptographic PRNG, then $X$ is a secure cryptographic
1201 The proposition is proved by contraposition. Assume that $X$ is not
1202 secure. By Definition, there exists a polynomial time probabilistic
1203 algorithm $D$, a positive polynomial $p$, such that for all $k_0$ there exists
1204 $N\geq \frac{k_0}{2}$ satisfying
1205 $$| \mathrm{Pr}[D(X(U_{2N}))=1]-\mathrm{Pr}[D(U_{kN}=1]|\geq \frac{1}{p(2N)}.$$
1206 We describe a new probabilistic algorithm $D^\prime$ on an input $w$ of size
1209 \item Decompose $w$ into $w=w_1\ldots w_{k}$, where each $w_i$ has size $N$.
1210 \item Pick a string $y$ of size $N$ uniformly at random.
1211 \item Compute $z=(y\oplus w_1)(y\oplus w_1\oplus w_2)\ldots (y
1212 \bigoplus_{i=1}^{i=k} w_i).$
1213 \item Return $D(z)$.
1217 Consider for each $y\in \mathbb{B}^{kN}$ the function $\varphi_{y}$
1218 from $\mathbb{B}^{kN}$ into $\mathbb{B}^{kN}$ mapping $w=w_1\ldots w_k$
1219 (each $w_i$ has length $N$) to
1220 $(y\oplus w_1)(y\oplus w_1\oplus w_2)\ldots (y
1221 \bigoplus_{i=1}^{i=k_1} w_i).$ By construction, one has for every $w$,
1222 \begin{equation}\label{PCH-1}
1223 D^\prime(w)=D(\varphi_y(w)),
1225 where $y$ is randomly generated.
1226 Moreover, for each $y$, $\varphi_{y}$ is injective: if
1227 $(y\oplus w_1)(y\oplus w_1\oplus w_2)\ldots (y\bigoplus_{i=1}^{i=k_1}
1228 w_i)=(y\oplus w_1^\prime)(y\oplus w_1^\prime\oplus w_2^\prime)\ldots
1229 (y\bigoplus_{i=1}^{i=k} w_i^\prime)$, then for every $1\leq j\leq k$,
1230 $y\bigoplus_{i=1}^{i=j} w_i^\prime=y\bigoplus_{i=1}^{i=j} w_i$. It follows,
1231 by a direct induction, that $w_i=w_i^\prime$. Furthermore, since $\mathbb{B}^{kN}$
1232 is finite, each $\varphi_y$ is bijective. Therefore, and using (\ref{PCH-1}),
1234 $\mathrm{Pr}[D^\prime(U_{kN})=1]=\mathrm{Pr}[D(\varphi_y(U_{kN}))=1]$ and,
1236 \begin{equation}\label{PCH-2}
1237 \mathrm{Pr}[D^\prime(U_{kN})=1]=\mathrm{Pr}[D(U_{kN})=1].
1240 Now, using (\ref{PCH-1}) again, one has for every $x$,
1241 \begin{equation}\label{PCH-3}
1242 D^\prime(H(x))=D(\varphi_y(H(x))),
1244 where $y$ is randomly generated. By construction, $\varphi_y(H(x))=X(yx)$,
1246 \begin{equation}%\label{PCH-3} %%RAPH : j'ai viré ce label qui existe déjà, il est 3 ligne avant
1247 D^\prime(H(x))=D(yx),
1249 where $y$ is randomly generated.
1252 \begin{equation}\label{PCH-4}
1253 \mathrm{Pr}[D^\prime(H(U_{N}))=1]=\mathrm{Pr}[D(U_{2N})=1].
1255 From (\ref{PCH-2}) and (\ref{PCH-4}), one can deduce that
1256 there exists a polynomial time probabilistic
1257 algorithm $D^\prime$, a positive polynomial $p$, such that for all $k_0$ there exists
1258 $N\geq \frac{k_0}{2}$ satisfying
1259 $$| \mathrm{Pr}[D(H(U_{N}))=1]-\mathrm{Pr}[D(U_{kN}=1]|\geq \frac{1}{p(2N)},$$
1260 proving that $H$ is not secure, which is a contradiction.
1264 \section{Cryptographical Applications}
1266 \subsection{A Cryptographically Secure PRNG for GPU}
1269 It is possible to build a cryptographically secure PRNG based on the previous
1270 algorithm (Algorithm~\ref{algo:gpu_kernel2}). Due to Proposition~\ref{cryptopreuve},
1271 it simply consists in replacing
1272 the {\it xor-like} PRNG by a cryptographically secure one.
1273 We have chosen the Blum Blum Shum generator~\cite{BBS} (usually denoted by BBS) having the form:
1274 $$x_{n+1}=x_n^2~ mod~ M$$ where $M$ is the product of two prime numbers (these
1275 prime numbers need to be congruent to 3 modulus 4). BBS is known to be
1276 very slow and only usable for cryptographic applications.
1279 The modulus operation is the most time consuming operation for current
1280 GPU cards. So in order to obtain quite reasonable performances, it is
1281 required to use only modulus on 32-bits integer numbers. Consequently
1282 $x_n^2$ need to be lesser than $2^{32}$, and thus the number $M$ must be
1283 lesser than $2^{16}$. So in practice we can choose prime numbers around
1284 256 that are congruent to 3 modulus 4. With 32-bits numbers, only the
1285 4 least significant bits of $x_n$ can be chosen (the maximum number of
1286 indistinguishable bits is lesser than or equals to
1287 $log_2(log_2(M))$). In other words, to generate a 32-bits number, we need to use
1288 8 times the BBS algorithm with possibly different combinations of $M$. This
1289 approach is not sufficient to be able to pass all the tests of TestU01,
1290 as small values of $M$ for the BBS lead to
1291 small periods. So, in order to add randomness we have proceeded with
1292 the followings modifications.
1295 Firstly, we define 16 arrangement arrays instead of 2 (as described in
1296 Algorithm \ref{algo:gpu_kernel2}), but only 2 of them are used at each call of
1297 the PRNG kernels. In practice, the selection of combination
1298 arrays to be used is different for all the threads. It is determined
1299 by using the three last bits of two internal variables used by BBS.
1300 %This approach adds more randomness.
1301 In Algorithm~\ref{algo:bbs_gpu},
1302 character \& is for the bitwise AND. Thus using \&7 with a number
1303 gives the last 3 bits, thus providing a number between 0 and 7.
1305 Secondly, after the generation of the 8 BBS numbers for each thread, we
1306 have a 32-bits number whose period is possibly quite small. So
1307 to add randomness, we generate 4 more BBS numbers to
1308 shift the 32-bits numbers, and add up to 6 new bits. This improvement is
1309 described in Algorithm~\ref{algo:bbs_gpu}. In practice, the last 2 bits
1310 of the first new BBS number are used to make a left shift of at most
1311 3 bits. The last 3 bits of the second new BBS number are added to the
1312 strategy whatever the value of the first left shift. The third and the
1313 fourth new BBS numbers are used similarly to apply a new left shift
1316 Finally, as we use 8 BBS numbers for each thread, the storage of these
1317 numbers at the end of the kernel is performed using a rotation. So,
1318 internal variable for BBS number 1 is stored in place 2, internal
1319 variable for BBS number 2 is stored in place 3, ..., and finally, internal
1320 variable for BBS number 8 is stored in place 1.
1325 \KwIn{InternalVarBBSArray: array with internal variables of the 8 BBS
1327 NumThreads: Number of threads\;
1328 array\_comb: 2D Arrays containing 16 combinations (in first dimension) of size combination\_size (in second dimension)\;
1329 array\_shift[4]=\{0,1,3,7\}\;
1332 \KwOut{NewNb: array containing random numbers in global memory}
1333 \If{threadId is concerned} {
1334 retrieve data from InternalVarBBSArray[threadId] in local variables including shared memory and x\;
1335 we consider that bbs1 ... bbs8 represent the internal states of the 8 BBS numbers\;
1336 offset = threadIdx\%combination\_size\;
1337 o1 = threadIdx-offset+array\_comb[bbs1\&7][offset]\;
1338 o2 = threadIdx-offset+array\_comb[8+bbs2\&7][offset]\;
1345 \tcp{two new shifts}
1346 shift=BBS3(bbs3)\&3\;
1348 t|=BBS1(bbs1)\&array\_shift[shift]\;
1349 shift=BBS7(bbs7)\&3\;
1351 t|=BBS2(bbs2)\&array\_shift[shift]\;
1352 t=t\textasciicircum shmem[o1]\textasciicircum shmem[o2]\;
1353 shared\_mem[threadId]=t\;
1354 x = x\textasciicircum t\;
1356 store the new PRNG in NewNb[NumThreads*threadId+i]\;
1358 store internal variables in InternalVarXorLikeArray[threadId] using a rotation\;
1361 \caption{main kernel for the BBS based PRNG GPU}
1362 \label{algo:bbs_gpu}
1365 In Algorithm~\ref{algo:bbs_gpu}, $n$ is for the quantity of random numbers that
1366 a thread has to generate. The operation t<<=4 performs a left shift of 4 bits
1367 on the variable $t$ and stores the result in $t$, and $BBS1(bbs1)\&15$ selects
1368 the last four bits of the result of $BBS1$. Thus an operation of the form
1369 $t<<=4; t|=BBS1(bbs1)\&15\;$ realizes in $t$ a left shift of 4 bits, and then
1370 puts the 4 last bits of $BBS1(bbs1)$ in the four last positions of $t$. Let us
1371 remark that the initialization $t$ is not a necessity as we fill it 4 bits by 4
1372 bits, until having obtained 32-bits. The two last new shifts are realized in
1373 order to enlarge the small periods of the BBS used here, to introduce a kind of
1374 variability. In these operations, we make twice a left shift of $t$ of \emph{at
1375 most} 3 bits, represented by \texttt{shift} in the algorithm, and we put
1376 \emph{exactly} the \texttt{shift} last bits from a BBS into the \texttt{shift}
1377 last bits of $t$. For this, an array named \texttt{array\_shift}, containing the
1378 correspondence between the shift and the number obtained with \texttt{shift} 1
1379 to make the \texttt{and} operation is used. For example, with a left shift of 0,
1380 we make an and operation with 0, with a left shift of 3, we make an and
1381 operation with 7 (represented by 111 in binary mode).
1383 It should be noticed that this generator has once more the form $x^{n+1} = x^n \oplus S^n$,
1384 where $S^n$ is referred in this algorithm as $t$: each iteration of this
1385 PRNG ends with $x = x \wedge t$. This $S^n$ is only constituted
1386 by secure bits produced by the BBS generator, and thus, due to
1387 Proposition~\ref{cryptopreuve}, the resulted PRNG is cryptographically
1392 \subsection{Toward a Cryptographically Secure and Chaotic Asymmetric Cryptosystem}
1393 \label{Blum-Goldwasser}
1394 We finish this research work by giving some thoughts about the use of
1395 the proposed PRNG in an asymmetric cryptosystem.
1396 This first approach will be further investigated in a future work.
1398 \subsubsection{Recalls of the Blum-Goldwasser Probabilistic Cryptosystem}
1400 The Blum-Goldwasser cryptosystem is a cryptographically secure asymmetric key encryption algorithm
1401 proposed in 1984~\cite{Blum:1985:EPP:19478.19501}. The encryption algorithm
1402 implements a XOR-based stream cipher using the BBS PRNG, in order to generate
1403 the keystream. Decryption is done by obtaining the initial seed thanks to
1404 the final state of the BBS generator and the secret key, thus leading to the
1405 reconstruction of the keystream.
1407 The key generation consists in generating two prime numbers $(p,q)$,
1408 randomly and independently of each other, that are
1409 congruent to 3 mod 4, and to compute the modulus $N=pq$.
1410 The public key is $N$, whereas the secret key is the factorization $(p,q)$.
1413 Suppose Bob wishes to send a string $m=(m_0, \dots, m_{L-1})$ of $L$ bits to Alice:
1415 \item Bob picks an integer $r$ randomly in the interval $\llbracket 1,N\rrbracket$ and computes $x_0 = r^2~mod~N$.
1416 \item He uses the BBS to generate the keystream of $L$ pseudorandom bits $(b_0, \dots, b_{L-1})$, as follows. For $i=0$ to $L-1$,
1419 \item While $i \leqslant L-1$:
1421 \item Set $b_i$ equal to the least-significant\footnote{As signaled previously, BBS can securely output up to $\mathsf{N} = \lfloor log(log(N)) \rfloor$ of the least-significant bits of $x_i$ during each round.} bit of $x_i$,
1423 \item $x_i = (x_{i-1})^2~mod~N.$
1426 \item The ciphertext is computed by XORing the plaintext bits $m$ with the keystream: $ c = (c_0, \dots, c_{L-1}) = m \oplus b$. This ciphertext is $[c, y]$, where $y=x_{0}^{2^{L}}~mod~N.$
1430 When Alice receives $\left[(c_0, \dots, c_{L-1}), y\right]$, she can recover $m$ as follows:
1432 \item Using the secret key $(p,q)$, she computes $r_p = y^{((p+1)/4)^{L}}~mod~p$ and $r_q = y^{((q+1)/4)^{L}}~mod~q$.
1433 \item The initial seed can be obtained using the following procedure: $x_0=q(q^{-1}~{mod}~p)r_p + p(p^{-1}~{mod}~q)r_q~{mod}~N$.
1434 \item She recomputes the bit-vector $b$ by using BBS and $x_0$.
1435 \item Alice finally computes the plaintext by XORing the keystream with the ciphertext: $ m = c \oplus b$.
1439 \subsubsection{Proposal of a new Asymmetric Cryptosystem Adapted from Blum-Goldwasser}
1441 We propose to adapt the Blum-Goldwasser protocol as follows.
1442 Let $\mathsf{N} = \lfloor log(log(N)) \rfloor$ be the number of bits that can
1443 be obtained securely with the BBS generator using the public key $N$ of Alice.
1444 Alice will pick randomly $S^0$ in $\llbracket 0, 2^{\mathsf{N}-1}\rrbracket$ too, and
1445 her new public key will be $(S^0, N)$.
1447 To encrypt his message, Bob will compute
1448 %%RAPH : ici, j'ai mis un simple $
1450 $c = \left(m_0 \oplus (b_0 \oplus S^0), m_1 \oplus (b_0 \oplus b_1 \oplus S^0), \hdots, \right.$
1451 $ \left. m_{L-1} \oplus (b_0 \oplus b_1 \hdots \oplus b_{L-1} \oplus S^0) \right)$
1453 instead of $\left(m_0 \oplus b_0, m_1 \oplus b_1, \hdots, m_{L-1} \oplus b_{L-1} \right)$.
1455 The same decryption stage as in Blum-Goldwasser leads to the sequence
1456 $\left(m_0 \oplus S^0, m_1 \oplus S^0, \hdots, m_{L-1} \oplus S^0 \right)$.
1457 Thus, with a simple use of $S^0$, Alice can obtain the plaintext.
1458 By doing so, the proposed generator is used in place of BBS, leading to
1459 the inheritance of all the properties presented in this paper.
1461 \section{Conclusion}
1464 In this paper, a formerly proposed PRNG based on chaotic iterations
1465 has been generalized to improve its speed. It has been proven to be
1466 chaotic according to Devaney.
1467 Efficient implementations on GPU using xor-like PRNGs as input generators
1468 have shown that a very large quantity of pseudorandom numbers can be generated per second (about
1469 20Gsamples/s), and that these proposed PRNGs succeed to pass the hardest battery in TestU01,
1470 namely the BigCrush.
1471 Furthermore, we have shown that when the inputted generator is cryptographically
1472 secure, then it is the case too for the PRNG we propose, thus leading to
1473 the possibility to develop fast and secure PRNGs using the GPU architecture.
1474 Thoughts about an improvement of the Blum-Goldwasser cryptosystem, using the
1475 proposed method, has been finally proposed.
1477 In future work we plan to extend these researches, building a parallel PRNG for clusters or
1478 grid computing. Topological properties of the various proposed generators will be investigated,
1479 and the use of other categories of PRNGs as input will be studied too. The improvement
1480 of Blum-Goldwasser will be deepened. Finally, we
1481 will try to enlarge the quantity of pseudorandom numbers generated per second either
1482 in a simulation context or in a cryptographic one.
1486 \bibliographystyle{plain}
1487 \bibliography{mabase}