![]() |
Job: | Lecturer |
| Address: | Dept. of Mathematical Sciences,
University of Durham, South Road, Durham DH1 3LE, England |
|
| FAX: | (0191 or +44 191) 334 3051 | |
| E-mail: | i.m.macphee@durham.ac.uk | |
| Phone: | (0191 or +44 191) 334 3106 |
Very complex models can be studied in this way. We have applied these techniques to interacting particle systems with hybrid interaction, long term behaviour of random walk in the plane with mild regularity conditions, various phenomena displayed by random walks on two-dimensional complexes (collections of quarter planes connected at their boundaries) inspired by models from computer science.
In 2003/04 we wrote, together with Serguei Popov and Stas Volkov, a paper on periodic behaviour for a type of stochastic billiards model that arises from projecting the trajectories of a transient three queue exhaustive polling system onto the unit simplex. It appeared in the Annals of Applied Probability in 2006 and can be downloaded from Project Euclid here. We expected that under a greedy switching rule (go to the queue with the most work) the server would eventually visit the queues in some periodic order but found that chaotic switching could occur on a parameter set of measure zero.
My first paper with Misha appeared in the Annals of Applied Probability in 2003. It contains a detailed analysis of the possible behaviours of a critical random walk on a complex of quarter planes joined at their boundaries - with just two quarter planes this would model a polling system with two queues.
From 2004 to 2006 I worked with a PhD student Lisa Müller on identifying criteria for stability and instability of two queue systems which have a range of different service regimes - these each have Poisson arrival streams and exponential service times but the parameters vary between regimes. Our aim was to specify all sets of system parameters such that there exist control policies (state dependent rules for deciding which service regime to apply) under which the system is stable or alternatively when the system is unstable under any control.
The notion of service regimes is a useful one as it allows very general purpose models but lets us describe the decision problem in a simple manner. It also fits together well with the available Lyapunov function or semi-martingale methods, see e.g. Fayolle, Malyshev and Menshikov's book , which deal very well with systems where the transition law is homogeneous over large regions.
In the course of the work it became clear to me that under some mild requirements on the available controls the very natural conditions we had found for stability of the two queue system could be extended to larger systems. The conditions are described in terms of the convex hull of the set of one step drift vectors (one for each service regime). The resulting paper appeared in Queueing Systems, V52 #3 in 2006. Here is a link to an earlier draft if you are interested in reading about our model and results.
We have also looked at extensions of our result for N queue sytems to Lu-Kumar type systems where some queues only receive jobs forwarded from other servers within the system - such systems do not satisfy the boundary reflection condition used in the QSys paper but there is a simple condition that permits the results to be extended. We have written a further paper which appeared in Methodology and Computing in Applied Probability V9 #3 in 2007 (here is a link to a draft). It contains an application of our ideas to a model studied by Nino-Mora and Glazebrook (J. Appl. Prob 2000).
We also have some results for the model with phase type service distributions and some ideas for treating switching times of various types. Lisa in now working the cycling organisation Sustrans so progress has slowed but I plan to return to this work when I have time.
I am now supervising another graduate student, Ahmad Aboalkhair, who started in May 2008. We are working together with Frank Coolen on extending the system reliability model discussed above. Progress so far has been good and we have had a paper proving an extension of the results with Coolen-Schrijner and Coolen accepted by JRR.
The problem with only 2 sites and Markovian dynamics had a conjectured solution due to Sheldon Ross sometime in the 1970s. Before each search calculate p, the probability that the target is at site 1. Ross suggests we search site 1 precisely when p > = P* (a threshold that depends on the costs, overlook probabilities and transition matrix) and otherwise search site 2.
Ben and I wrote a paper establishing the conjecture for almost all transition matrices which was published in PEIS V9, pp159-182. Here is a .pdf file of a draft of the paper for those who do not have easy access to the 1995 issues of PEIS.
Ben did a lot of numerical work and symbolic manipulation on the two site problem but also on cases with three and four sites. Alas he went to work as a currency trader before completing this work.