-
A
linCmt()sensitivity row's state-transition matrix and its parameter derivatives are now assembled from their CLOSED FORM in the constants the theta-keyed window already holds -- the eigenvalues and spectral matrices,ka, and each of their tangents -- rather than by probing the kernel with unit-basis prior states. The probe needs one kernel evaluation per direction per column, so it could only pay for itself on an interval that demonstrably recurs, and it had to exclude rate-bearing rows; the closed form costs about one kernel evaluation altogether, so it is assembled for any interval -- irregular designs, first occurrences and infusions included -- and cached where the interval repeats, which is where the reuse is worth more than any build. This is the same exact closed form summed in a different order (the matrix assembled, then applied), the order the transition-matrix path already shipped, so it can differ from the row-by-row order in the last few digits: measured against the row tail the disagreement is a few units in the last place, and against reverse mode it is the same spread the row tail itself has. Where the probe engages -- and its entries are exact by construction -- the two matrices agree to 1e-14. Measured on an optimized build against the previous default, the closed-form route is never meaningfully slower and is up to 2.2x faster on the designs the probe could not serve. Which designs those are is the whole of it: where the sampling is regular the probe already served nearly every row and nothing changes, and the gain is on schedules whose intervals do not repeat. It carries into a fit -- a 40 subject by 100 observation two compartment oral FOCEi fit runs 1.37x faster on an irregular schedule (53.4s to 38.9s) and unchanged on a uniform one, with the objective function identical to 1e-11. The probe-built route stays available aslinCmtSensPhi=1, andFALSEstill evaluates row by row in the order earlier versions used.linCmtSeqStats()reports the rows served asphiAnalyticRows. -
The
linCmt()sensitivity delta memo now keeps serving a row's own repeat executions after its give-up guard has disarmed. The guard stops the window building exponentials for gaps that never recur, which is what a schedule with no repeated interval produces; but one row is looked up several times under one set of parameters -- once perlinCmtB()call the model generates, and again on every inner re-walk of a fit -- and disarming was discarding those repeats too, so an irregular design rebuilt the exponentials, and withlinCmtSensPhi=2reassembled the transition matrix, once per EXECUTION rather than once per row. A slot outside the round-robin now holds the current row's gap while the guard is disarmed; it is never read as evidence that an interval recurs, so the guard's reading of the design and the probe-built route's engage rule are unchanged. Results are bitwise identical either way (the memo is exact caching, tested with it forced on and off). Measured on a 40 subject by 100 observation two compartment oral FOCEi fit, an irregular sampling schedule runs 1.14x faster and a uniform one is unchanged, which brings the cost of an irregular schedule relative to a uniform one from 1.31x to 1.08x.linCmtSeqStats()reports the builds served this way asexpSolo. -
linCmtSensType="ADm"differentiates thelinCmt()closed form with every requested direction carried through a SINGLE forward-mode pass, where"AD"repeats the whole evaluation once per direction with one tangent each. The solution itself -- each exponential, each division of the depot transfer, the eigen-decomposition -- is therefore evaluated once per row rather than once per direction. Results match"AD": the multi-direction scalar reproduces the operation order of every forward-mode rule it replaces, and carries the same Eigen cost traits so the small matrix products unroll the same way (validated over 1/2/3 compartments x IV/oral x everytransx every steady-state form x infusion x every requested-direction mask). On the amortized row path that is bitwise on every platform tested. The two are different template instantiations, though, so a compiler may contract a multiply-add into an FMA in one and not the other; through the full evaluator that is what clang on arm64 does, and there the two agree to round-off rather than to the bit. Unlike the amortized ordinary-row path this also shares the work on steady-state rows, which have no constants/tail factorization and so were paying a full evaluation per direction.linCmtSeqStats()reports the rows served asdualRows. -
Model parsing is no longer superlinear in model size.
statementin thedparsergrammar could derive the empty string (its last alternative was a bareend_statement, which is(';')*), sostatement_list : (statement)+admitted any number of empty statements at every position.dparserresolved that ambiguity by greediness, re-walking the whole accumulated parse tree at each position, and every parse in the package paid for it --rxode2(),rxNorm(),rxModelVars(),rxS()andrxOptExpr()alike. Requiring a semicolon in that alternative makes the grammar unambiguous. On a 301-line modelrxNorm()drops from 3.18s to 0.07s andrxOptExpr()from 5.61s to 0.43s; per-line parse cost, which grew tenfold between a 25-line and a 301-line model, is now flat. Model text that is only whitespace and comments is now treated as a blank model, as an empty string always was.One degenerate form is no longer accepted as a consequence: an
iforwhilewith no body at all and no braces (if (a > 1),while (a > 1),if (a > 1) else b <- 1). These used to parse because a statement could be empty, which is the ambiguity being removed -- an empty body makesif (a > 1) b <- 1ambiguous, sinceb <- 1could be the body or the next statement, so the old behavior cannot be kept alongside the fix. Write an empty body as{}or;(if (a > 1) {}), both of which parse as before. Bodies that only look empty, such as a block holding nothing but a comment, are unaffected. R rejects all three of these too, so the grammar now agrees with R where it used to be more permissive, and they are reported as an ordinary model syntax error naming what to write instead rather than as a bare parser error. -
The common-subexpression search in
rxOptExpr()runs in C. It counted subexpressions in a named R list and looked them up with[[text]], a linear scan, so the search was quadratic in the number of distinct subexpressions -- which on a second-order sensitivity model is enormous. A new dparser grammar (inst/rxCse.g) and C pass (src/rxCse.c) count into a hash instead, one statement at a time across threads, and the counts are merged by the earliest position each subexpression was seen so the result does not depend on the thread count. On a 286-line second-order model the search drops from ~143s to ~1.5s. Output is byte-identical; anything the C pass will not reproduce exactly -- an unsupported left-hand side,past(), a numeric literal it cannot render the wayas.character()would -- makes it decline so the R implementation runs. Setoptions(rxode2.optExprC = FALSE)to force the R implementation. -
rxOptExpr()decides whether to chunk on the model's SIZE rather than its line count. Chunking amortizes the parse, and parse cost tracks characters, so a model with many short lines was being chunked when chunking made it slower. The threshold isoptions(rxode2.optExprChunkChars = ), default 512 KB;chunkLines=still caps the chunk size andchunkLines = 0still forces a single whole-model pass. A model between 40 lines and the size threshold is now optimized whole, so it gets better sharing and norx_expr_c<i>_temporaries. -
options(rxode2.compile.O=)now reaches the compiler. The level was written into the generated model'sPKG_CFLAGS, andR CMD SHLIBputsPKG_CFLAGSahead of R's ownCFLAGSinALL_CFLAGS, so R's-O2came last and won -- the option had no effect and every model was built at-O2whatever it was set to. The level is now applied through a temporary user Makevars for the duration of the build, so the documented default (-O3) is what models are actually compiled at. Only the-Ois changed; R's other flags, and anyCFLAGSthe user sets in their own Makevars, are left alone. -
rxNorm()parses a model once rather than twice. With no condition set it askedrxCondition()whether one was, andrxCondition()'s lookup key is a digest of the normalized model -- so the model was normalized to build the key, the text discarded, and then normalized again to be returned. It is now normalized once and the same text used for both.rxOptExpr()also dropped an unusedrxModelVars()call, so onerxOptExpr()now parses once instead of three times. On a 301-line modelrxNorm()drops a further 0.074s -> 0.039s andrxOptExpr()0.43s -> 0.34s. -
Symbolic derivative setup (
rxS(),.rxJacobian(),.rxSens(), and so thenlmixr2estmodel builds that use them) is 4-5x faster. The cost was neversymengineitself --symengine::D()is under 1% of the total -- but the R text translation around it:rxFromSE()re-parsed everysymenginestring with R'sparse(), emitted through nestedpaste0()and a nine-deepsub()regex chain, and saved and restored the wholeoptions()list on every leaf. Two changes address it. The.rxSEcntconstant renderings are now computed once when the package is built instead of byeval(parse())on each numeric leaf. A newdparsergrammar (inst/seFromSE.g) and C emitter (src/seFromSE.c) then translatesymengineoutput directly; expressions the emitter does not reproduce exactly fall back to the R walker, so output is unchanged..rxSens()on a fifteen-state model drops from 1.27s to 0.19s. Setoptions(rxode2.symengineC = FALSE)to force the R walker. Thesymengineexpressions of a jacobian or sensitivity build are now translated as one batch rather than one call per line, and the batch is spread across threads once it is large enough to pay for them. -
linCmtSensType="auto"stays forward-mode AD ("AD"). An intermediate development version made reverse-mode AD ("ADr") the default on the strength of timings that had been taken throughdevtools::load_all(), which compiles at-O0; on an optimized build forward mode is at least as fast as reverse for every number of requested sensitivity directions on every configuration, and reverse is 2-4x slower on a three compartment oral model, because its per-row tape build costs more than the extra forward passes."auto"therefore resolves to"AD"on every solve path (rxSolve(), threaded solves,ind_solve()andlinCmtModelDouble()), and"ADr"remains an explicit option. -
Reverse-mode AD (
linCmtSensType="ADr") now solves across threads: the Stan tape is per thread underSTAN_THREADS, so it is no longer forced onto one core. Results match forward mode to round-off. -
The
linCmt()forward-mode sensitivity evaluation is amortized across rows: the theta-only constants of the closed form (the elimination constant or the 2/3-compartment eigen-decomposition, and ka) and their derivatives are taken once per theta-keyed window, and each ordinary row costs one allocation-free forward pass per requested direction through the dt-dependent tail of the solution (steady-state rows and the finite-difference families keep the full evaluator). Together with the removal of per-row heap allocation from the sensitivity hot path this makes the sequential sensitivity solve 1.6x (two-compartment) to 2.1x (three-compartment) faster on an optimized build, with results identical to round-off.linCmtSeqStats()reports the window refills and how many rows took the amortized tail. The per-subject hybrid strategy this window machinery was first built for (rxSolve(linCmtSensStrategy=)and thelinCmtHybrid*thresholds, introduced on this development branch and never released) was measured to win nowhere once the sequential path itself was amortized, and has been removed. -
A last-row value memo removes the repeated work of the generated model executing the same
linCmtB()value call many times per row (measured: about fifteen executions per row -- five full computations and ten restores). A repeat with an identical key returns the cached value with the Jacobian left standing for the sensitivity reads; sentinel calls and model reshapes invalidate the memo. Measured on an optimized build this makes the sequential sensitivity solve a further 1.5x (two-compartment) to 2.3x (three-compartment, sparse) faster; results are identical.linCmtSeqStats()now also reports the value-execution classes and the memo hits. -
A thin value path consolidates the two per-row visits a fit makes to a pure
linCmtB()row (the solver's state fill and the left-hand-side walk): a value re-execution of an already-solved row now returns the saved amounts and concentration scaling only, skipping the sensitivity setup, the rate cache, the Jacobian restore and the concentration gradient recompute. The Jacobian is restored lazily if a sentinel or read call for that row follows, so carry models are unaffected (tested against reverse mode).linCmtSeqStats()reports the served executions asvalueLite; in a FOCEi posthoc evaluation the left-hand-side walk is served entirely by this path. -
A delta-keyed memo caches the tail's dt-dependent exponentials (and their derivative in every requested direction) per distinct row gap under the theta window, so designs with repeated observation spacing evaluate their sensitivity rows without recomputing any exponential -- a uniform sampling schedule needs one exponential build per window and every other row is multiply-only. The memo is exact caching (bitwise identical results, tested), sized at four gaps from measured designs, and can be disabled with
RX_LINCMT_DELTA_MEMO=off; a design with no gap reuse stops building speculatively after eight consecutive misses so it pays essentially nothing; a stretch whose gap repeats the previous row's -- what a regular sampling schedule produces and an irregular one does not -- re-arms it, so an irregular stretch no longer disables the memo for the regular rows that follow it under the same parameters.linCmtSeqStats()reports the builds and hits. -
Where a
linCmt()sensitivity row's interval repeats -- as it does under regular sampling, and across the dosing intervals of a repeated regimen -- that interval's state-transition matrix is now assembled once and the later rows of the same width propagate through it, instead of evaluating the closed form again in every requested direction. Measured at 1.1 to 1.6 times faster on those designs, most at three compartments and many directions. The matrix is built only when a different row is seen to share an interval width -- the one thing that shows the interval really does recur in the design -- so a design whose intervals never repeat builds none and is unaffected, in a fit as in a single solve. (A row re-queried while a fit's inner problem re-walks a subject is the same interval asked about twice, not a recurrence, and does not count.) Each subject starts from a blank interval state, so a solve is unchanged by the number of threads it runs on. Rate-bearing rows of an infusion and steady-state rows keep the previous route.This is the same exact closed-form solution evaluated in a different order: the interval's matrix is summed first and then applied, where the previous route accumulated the same products as it went. Floating-point addition is not associative, so the two can differ in the last few digits -- neither is an approximation of the other and neither is the more correct. Measured over every compartment count, parameterization, regimen and direction mask, the largest disagreement was a few units in the last place of the values involved (against an independently integrated reference the new order was in fact the closer of the two slightly more often).
rxSolve(linCmtSensPhi=FALSE)restores the previous order for anyone who needs to reproduce earlier results digit for digit;linCmtSeqStats()reports how many matrices were built and how many rows used one. -
linCmtB()derivatives are now emitted as direct reads of the sensitivity state columns: the parser registers a derivative slot when arx__sens_<cmt>_BY_<slot>state is referenced as a bare symbol, and the derivative table writes the concentration gradient as arithmetic over those states (matching the internal per-transscaling exactly, so results are bitwise identical; atranswithout a covered scaling keeps the call form). A FOCEi inner model drops from about elevenlinCmtB()executions per row to the single value call. The measured effect is modest (the read calls already short-circuited cheaply): about 1.0-1.1x on the sensitivity solve and 1.04x on a dense FOCEi fit, with the identical objective. -
rxPriorLogDensity(ui, theta, omega)evaluates a model'sini({})priors as a Bayesian penalty at the current parameter values -- the value and gradient kernel an estimation method's objective function needs, as opposed torxSolve()'s use of the same priors to simulate study-level variability around the initial estimate. Supportsdnorm()/stdNormal(),dcauchy()(bounds-truncated using the parameter's ownlower/upper), the joint theta+omegamultiNormal()block, andinvWishart()degrees of freedom on an omega block, with three methods:"general"(a textbook Bayesian log density),"nwpri"(NONMEM's own$PRIOR NWPRIomega parameterization, NONMEM7 Technical Guide eq. 1.157/1.159/1.170, which is not the same density as the textbook one), and"tnpri"(the assumption Monolix's Bayesian estimation and NONMEM's own estimation make -- all estimated parameters, including omega, are jointly normal; anom.<eta>member is on the same raw omega scale as"general", since neither Monolix nor NONMEM place the prior on a Cholesky factor). Neither"nwpri"nor"tnpri"has a Cauchy analogue (nlmixr2/nlmixr2est#929).The value/gradient math itself (
rxPriorLogDensityEval()) is pure C++ with no R/Rcpp call of any kind, added to rxode2's C function-pointer table (inst/include/rxode2prior.h) so a downstream package's own C++ objective function can call it directly from inside an OpenMP-parallel region --rxPriorLogDensity()is a thin R convenience wrapper over it.rxPriorBuildSpec(ui, method)builds the reusable spec the evaluator needs (an R-only, one-time, main-thread step).rxPriorOmegaToCholOmegaInvGrad(omega, gradOmega)chain-rules a raw-omega-scale gradient (fromrxPriorLogDensity(), or from anywhere else) into the equivalent gradient with respect to the upper-triangular free elements ofchol(Omega^-1)-- the parameterization FOCEI's ownop_focei.cholOmegaInvvaries internally (nlmixr2est/src/inner.cpp). A method that estimates omega directly (SAEM) does not need this conversion. Like the density kernel itself, the underlyingrxPriorOmegaToCholOmegaInvGrad()C++ function is pure, with no R/Rcpp call, and is exposed through the same function-pointer table. -
rxPriorLogDensity()/rxPriorBuildSpec()now evaluate a marginaldnorm()/dcauchy()prior placed directly on ONE omega covariance (off-diagonal) element, not just a diagonal (variance) one --prior(eta.cl, eta.v) ~ dnorm(0, 0.1)in a model whoseeta.cl/eta.vcovary. This is distinct from a whole-block distribution (invWishart()/multiNormal()), which still requires naming the model's entire connected block; a marginal prior only needs its two names to covary with each other, so it also works on a two-name subset of a larger correlated block. Previously refused outright with "a prior on an off-diagonal omega element is not supported" -- unreachable through realini()syntax until lotri's ownprior(a, b) ~ dnorm(...)parsing was relaxed to allow it (see lotri's own NEWS).rxSolve(..., usePrior=TRUE)'s simulation path does not yet support this (it draws a deviation added to the model's own initial estimate, which this needs its own machinery for) and gives a clear error rather than the confusing one this would otherwise have produced. -
rxSetActiveParLoader()/rxClearActiveParLoader()activate a registered parameter loader for solves that do not go throughrxSolve.rxUi()-- an estimation method's internal solves, for example. Previously the only way in was to.Call()rxode2's compiled entry points by name from another package, which is not a supported interface (andR CMD checkflags it). -
rxRegisterUiAssembled()/rxRemoveUiAssembled()register a hook called with a freshly assembledrxUibefore it is compressed. This is the point at which a package can attach parse-time state to a model: a user-defined function (rxUdfUi()) can only return code, and once the ui is compressedrxUiDecompress()yields a fresh environment on every call, so an in-place assignment made any later is invisible to the caller. The hook receives the ui environment and may assign into it; pair that withstickyso the slot survives piping andsaveRDS(). -
A parameter carried in
rxForcedPars()now counts as supplied when solve parameters are resolved. Previously the forced values were written after resolution had already rejected the solve, so a parameter that existed only as a forced parameter failed with "the following parameter(s) are required for solving" and needed a placeholder data column purely to get past the check. This lets a model own parameters that never appear in the data. -
A solve-time ui preparation hook registered with
rxRegisterUiPrep()may now take(ui, solveModel)rather than only(ui).solveModelis the model whose parameter order thegparslayout actually uses, which a hook that resolves parameter positions by name needs. Existing one-argument hooks are unaffected. -
rxSolve()simulates parameter uncertainty from the prior distributions the model'sini({})block specifies, which is what NONMEM does with$PRIOR NWPRIand$PRIOR TNPRI. Writing a prior in theini({})block needslotri1.0.7 or newer; with an olderlotrithe block cannot express one and prior simulation simply does not engage.omegaSeparation="tnpri"below works with anylotri. A model that carries priors uses them whenever variability is simulated, sorxSolve(model, ev, nStud=100)is all that is needed.Each omega block is drawn from an inverse Wishart with its own degrees of freedom (
prior(eta.cl, eta.v) ~ invWishart(20)), which the singledfSubargument cannot express; a block with no prior is left at its point estimate. A normal prior on a population parameter (tka ~ 0.01) gives thethetaMat, and a block may name omega elements as well (tcl + om.eta.cl ~ c(...)) for one joint variance over the thetas and the omega values.A prior mean has to be what the model already says the entry is, since the draw is added to that value; a prior centered elsewhere is an error rather than a simulation that quietly differs from the model.
Because a jointly drawn omega is not guaranteed positive definite, such a draw is retried up to
priorPdRetrytimes (10 by default); if none is, the nearest positive definite matrix of the kept draws is used with a warning, since the projection is biased toward singularity.usePrior=FALSEignores the priors. Priors take precedence over athetaMat/dfSubcarried in the model'smetablock, with a warning; one given at the call site wins over the priors instead. Chunked solves (#1252) are a clear error rather than a solve that silently drops the prior.Nested/occasion models are supported (#1253): each prior's degrees of freedom go on the nesting level holding its block, and a level with no prior stays at its estimate. Because a level is drawn as a whole, a prior covering only part of a level is an error -- drawing it would redraw the rest of the level and correlate blocks the model declared independent.
-
rxSolve(omegaSeparation="tnpri")(andsigmaSeparation="tnpri") draws the omega/sigma entries carried in athetaMatjointly with the thetas, rather than redrawing their correlations with a separation strategy. This is the general form of theTNPRIabove, for athetaMatthat did not come from anini({})block prior.A covariance step already gives one:
nonmem2rxemits athetaMatwith columns likeIIVCL, omega1.2, IIVV1, ...and a nlmixr2 fit's$covusesom.<eta>/cov.<eta1>.<eta2>. Both spellings are recognized, as are the sigma equivalents. Until now the off-diagonal entries were dropped as "too many items" and the correlations were redrawn from LKJ, discarding what the covariance step measured; drawing them jointly also keeps the covariance between a theta and an omega entry, which no separation strategy can carry.It is opt-in because an eta-named
thetaMatcolumn already means that eta's variance under the existing strategy, so the same column cannot silently change meaning.omegahas to be a matrix, since the draws are added to it. -
rxUiPriors()returns the priors a model specifies, with the parameter name, the prior, itsneta1/neta2(NAfor a population parameter) and the parameter'slower/upperbounds. The predicatestestRxUiPriors(),testRxUiNormalPriors(),testRxUiOmegaDf()andtestRxUiOmegaNormalPriors()report what kind of priors are present, so a method that implements priors can branch instead of asserting.testRxUiOmegaDf()andtestRxUiOmegaNormalPriors()are mutually exclusive, since an omega prior is either degrees of freedom (NWPRI) or a normal prior (TNPRI) and lotri rejects a model that gives both. -
assertRxUiNoOmegaDf()andassertRxUiNoOmegaNormalPriors()reject the omega prior forms a method cannot use, theNWPRIandTNPRIones respectively. -
assertRxUiNoPriors()andassertRxUiNormalPriors()let an estimation method declare which prior distributions it can use. A prior specified in theini({})block must never be silently ignored -- that would make the fit do something other than what the model says -- so a method that cannot use priors callsassertRxUiNoPriors()and one that only handles normal priors callsassertRxUiNormalPriors(). Both are no-ops when the installedlotrihas no prior support, since then there are no priors to reject. -
rxSolve(zeroVarParamHandle=)says what happens whenparamssupplies a value for an omega/sigma item whose variance is zero (sayeta.base ~ fix(0)). Such an item is dropped from the matrix that is simulated from and given to the model as a literal zero instead, which discards the supplied value:"warn"(the default) does that and says so,"ignore"does it silently, and"keep"uses the supplied value. -
rxSolve(safeLog=2)floorslog(0)atlog(.Machine$double.eps)the waysafeLog=TRUEdoes, but treats a negative argument as a domain error and returnsNaN.safeLog=TRUE(the default) andsafeLog=FALSEare unchanged. This is for a hand-written likelihood takinglog()of a parameter that must stay positive: undersafeLog=TRUEan invalid negative value returns a large finite number, which-log(sigma)turns into a reward of roughly+36per observation instead of a rejection. -
A function that produces models can now name them.
rxModelName()is ans3generic dispatched on the name of the function that was called, so arxModelName.readModelDb()method names every modelrxode2(readModelDb("PK_1cmt"))builds (here,"PK_1cmt") instead of leaving it named after the text of the call. The method is given the call and its (unevaluated) arguments, matched to the argument names of the function being called; a call with no method keeps the default name. -
rxModelVars(m)$indLin$wIndLinnow reports the states whoseindLin(<state>) <- <expr>forcing references a compartment, rather than always being empty. It is worked out by replaying the parsed assignments and forcings in source order, so hand-writtenmatExp()models are covered as well as converted ones, and a forcing that reaches a compartment only through an assigned variable (cp <- central/20) counts too; a forcing built only from parameters or covariates (e.g.indLin(Gc) <- Gprod) stays unflagged, as does one whose variables were reassigned to something state free before it reads them. A forcing inside anif/whilemay not run, so it adds to what the forcings before it established rather than replacing them. In a model that also has alinCmt(), every forcing is flagged: a solved concentration moves within the step, so such a forcing cannot be treated as constant over the interval the way a locf covariate can. The entries are the 0-indexed positions in$state, named with those states. -
rxModelNameLhs()registers the name an assignment is making, for assignment operators likenlmixr2save's:=(fit := nlmixr2(...)). It names the model when the model expression itself names nothing -- an anonymous model function, or a call with norxModelName()method -- so the model is built with that name rather than none.rxModelNameFromExpr()exposes the whole naming sequence for packages that capture a model expression withsubstitute(). -
rxMemoryEstimate()now accounts for whatmethod="indLin"allocates, as two new components:indLinExpCache(the per-thread matrix-exponential cache) andindLinWork(the per-thread solver scratch). Both depend on which driver the model runs -- a purematExp()model holds one rate matrix, while true inductive linearization iterates and carries a Jacobian,P(h)and its inverse as well -- and both scale withcoresrather than with subjects, sorxSolve()reaches the same out-of-memory decision formethod="indLin"that it already reached for every other solver, andrxSolveChunked()sizes its chunks without charging per-thread buffers to each subject. -
rxSolve(method="indLin")now solves subjects in parallel and honorscores. Inductive linearization was held to a single core because it was listed with the Fortran COMMON-block solvers (lsoda,lsode,bdf); it is not one of them, and its matrix-exponential and scheme caches were already per thread. It now goes through the same thread-safety switch asliblsoda, so a model whose functions are not thread safe still drops to one core with the usual warning. The answer, and therxIndLinSteps()step counts, are unchanged from the single-core solve. -
Solve-time hooks let a package change what a solve sees from outside the model text.
rxForcedPars(ui) <- c(cl = 1.2)sets parameter values that overrideparams/data and the initial estimates on every solve; they are stored on the ui (hidden from the printed model, registeredsticky), so they survive piping and travel into anlmixr2fit built from that model, which keeps a fit carrying externally-owned values (e.g. trained weights) self-contained. For a block that is computed rather than fixed, a package registers a C par-loader (rxRegisterParLoader()) that runs once per solve, single-threaded, after the global parameter matrix is laid out and before integration;rxInjectedPars()reports what it changed, and those values are saved on the solved object so re-solving reproduces them in a session where the injecting package's buffer is gone. A loader registered withrxRegisterParLoaderNamed("<pkg>:<fn>")runs only for a model that flags that name withrxParLoader(ui) <- "<pkg>:<fn>", so an injector cannot reach an unrelated model; an unnamed loader keeps running on every solve.rxRegisterDydtForce()adds a term to a state derivative at the end of the generated model's RHS, so it is integrated like any other -- it runs inside the parallel per-subject solve, so such a callback must be thread safe and must checkneq[0]before writing adydtslot.rxRegisterUiPrep(name, fn)callsfn(ui)at the start of every ui solve, before parameters are loaded, so a package can rebuild C-side state that a saved-and-reloaded ui no longer has; resolve positions by name rather than a stored index, and keep it cheap and a no-op for models it does not own, since it runs on every ui solve. A failing prep hook is downgraded to a warning. Pair each registration withrxRemoveParLoader()/rxRemoveDydtForce()/rxRemoveUiPrep()in.onUnload(). See the solve-time hooks article. -
Building a symengine environment with
rxS()no longer rebuilds its function symbols on every call (#1283). The opaque symbols it loads (linCmtA(),delay(),lag(), the derivative helpers, ...) were made by splicing each name into a fresh function body, so R created -- and byte-compiled -- about 250 new closures per call. They now share one body, are built when the package itself is built, and are reused by every symengine environment; a user function registered at run time withrxFun()orrxD()is built the same way on first use. This removes a fixed per-call cost for every consumer that loads models into symengine repeatedly, such as an nlmixr2 fit; the saving is largest for small models and in apkgload::load_all()session, where the discarded closures were byte-compiled again on each call. -
Translating a model no longer grows process memory without bound (#1289). Three leaks, none of them visible to
gc(),rxUnloadAll()orrxClean(), and all of them paid again every time an already-translated model was translated again:-
.rxModelVarsCharacter()derived the parse prefix fromtempfile(), so it differed on every call.rxTrans.character()is memoised and memoise keys on its arguments, so each call missed the cache and added an entry to it -- about 0.4 MB perrxModelVars()/rxNorm()call. The prefix is now derived from the model, which is the only thing it has to distinguish. Translating also leaves the parsed model in the C parser's state, which the code generator reads, so the two callers that translate for that state (rather than for the returned model variables) now ask for a real translation -- otherwise a cache hit left the parser holding some other model andrxDelete()followed by$compile()could not regenerate its code. -
reset()(src/tran.c) allocatedtb.lhobesidetb.lh, butparseFree()freed onlytb.lh, leakingMXSYM * sizeof(int)(~200 KB) per parse. -
.udfAddToSearch()appended the calling environment to a list that was never pruned, pinning a call frame per$on arxUi, perrxSolve()and perrxode2(); its index also had to mint a new name per environment, and R interns names for the life of the session. The list is now bounded byoptions(rxode2.udfSearchLimit = )(default 20, oldest forgotten first) and membership is tested by identity.
Repeating the reprex from the issue -- 500
rxNorm()calls on one model -- grew process memory by ~190 MB before and does not measurably grow it now. -
-
ind_solve()now solves the subject it is asked for, whatever order the solve loop is in (nlmixr2/nlmixr2est#1020). Itscidargument is a subject id --ind_solve()itself indexesrx->subjects[cid]with it -- but most of the per-individual drivers it dispatches to mapped it throughrx->ordIdfirst, i.e. read it as a position in the run-time-ordered solve sequence. The two readings agree only whilerx->ordIdis the identity, andsortIds()deliberately reorders subjects most-expensive-first once there are at leastthrottletimes more threads than subjects. From then on an external per-individual driver -- such as nlmixr2est's FOCEi, which solves one subject at a time throughind_solve()-- had its subject id reinterpreted as a position, so the wrong individual was integrated while the caller attributed the result to the subject it asked for. A fit's objective function and estimates therefore depended on the solve order, and since that order comes from wall-clock timing, the same fit on the same data could give different answers from run to run. Every driver now reads the argument as a subject id and the position -> id mapping happens in thepar_*()loops that walk positions, so the load-balancing order is unchanged andrxSolve()results are unaffected. -
method="lsoda","lsode","bdf"and"indLin"now draw the same random numbers for a subject as every other solver does. Eachpar_*()loop seeds the per-subject stream immediately before solving that subject; these four seededseed0 + solveid - 1where the others seedseed0 + id, so a model containingrxnorm()or similar gave a different simulation underlsodathan underliblsodafrom the sameseed=, and the first subject was seeded outside the blocksetRxSeedFinal()reserves, which could repeat a seed used by an earlier solve. Simulated values from these four methods therefore change; the other methods are unaffected. -
Solving twice in one session with an explicit
seed=no longer re-uses seeds the first solve already spent. Eachpar_*()loop claims a block of per-subject seeds withgetRxSeed1(cores)but consumes one per subject, so it has to close the block withsetRxSeedFinal(seed0 + nsolve); 97 solvers never did, leaving the global seed advanced bycoresrather than bynsolve.par_cvodesadj()additionally never calledsetSeedEng1()at all, so its subjects inherited whatever stream happened to be current instead of a per-subject one. Simulated values from the affected methods change.
-
loggamma()no longer fails to compile. It is symengine's name forlgamma()and the parser accepted it, but code generation emits the rxode2 name verbatim as the C name and there is nologgamma()in C, so a model using that spelling parsed and then failed at the compiler. (gammafn()andlgammafn()in the same table work only because they happen to coincide withRmath.h.) Its derivative was never affected: symengine differentiatesloggammanatively topolygamma(0, x), so a model differentiating it already got the exactdigamma(). -
ceiling()is now a supported function. rxode2 knew C'sceil()but not the name R users actually write, and becauseceilingwas absent from the function table it fell through to the user-defined-R-function path, found base R's primitiveceiling, and reported "user function 'ceiling' requires 0 arguments (supplied 1)" --formals()of a primitive is empty.floor()had worked the whole time.ceiling()now parses, compiles toceil(), takes one argument, and is locally constant likeceil(),floor()andround(), so its derivative is 0 and it can be used in models that take sensitivities. -
Symbolic translation now simplifies constant arithmetic instead of emitting it. A fully constant expression folds to its value (
1/gamma(2)is1, not1/1), extending the fold that was already applied to the right-hand operand of every binary operator, and the arithmetic identities are applied:x/1,x*1,1*x,x+0,0+xandx-0all reduce tox, the same identity as thex^1rule that was already there. Only the right-hand operand is folded, so0-xand1/xare correctly left alone. The named constants still win, sopi*2remainsM_2PIrather than becoming6.28.... This shows up most in generated sensitivity code, where differentiating leaves a great many*1and+0terms behind; the emitted values are unchanged. -
psigamma(),log1pmx()andpolygamma()now check how many arguments they were given. All three guarded the count withlength(x == n)instead oflength(x) == n;xis a call, sox == ncompares its elements andlength()of that is always at least one, leaving the guard permanently true and the error below it unreachable. Too few arguments failed with "subscript out of bounds" from the missing element, and extra arguments were silently dropped --psigamma(a,b,c)translated aspsigamma(a,b)andpolygamma(0,x,y)aspolygamma(0,x). Correct calls are unaffected.
- The exported
.iniHandleFixOrUnfix()alias is removed (#1250). It was an alias for.iniHandleLine()-- the same function -- kept only while nlmixr2est called the old name, which it no longer does (nlmixr2/nlmixr2est#925). Anything still calling it should call.iniHandleLine(), which takes the same arguments and does the same thing.
- A prior distribution can now be set by piping, not only written in the
ini({})block (#1254):
mod |> ini(prior(tka) ~ dnorm(0, 10))
mod |> ini(prior(eta.cl, eta.v) ~ invWishart(4))Piping a prior replaces whatever was on that parameter, the way piping a
label or an estimate does. The line is validated by lotri in the
context of the real parameters rather than by a second implementation
here, so a piped prior is checked exactly like one written in the block.
Note the normal prior shorthand keeps its piping meaning: mod |> ini(tka ~ 4) still changes the initial estimate, as it always has. Use
the explicit prior() form to set a prior by piping.
-
confint()on a solved object now says whether thethetaMatthe solve was given was actually drawn from. AthetaMatis ignored unless the variability is being simulated (nStud > 1, orsimVariability=TRUE), so the message makes it clear whether the reported interval carries parameter uncertainty. Nothing is said when the solve had nothetaMat(#1308). -
confint()on a solved object again uses the study dimension to build the confidence bands around the simulated percentiles whennStud > 1. When the event table holds a single subject, rxode2 numbers thenStud * nSubsimulations insim.idand emits noidcolumn, andconfint()read thatsim.idas the individual identifier; it therefore ignorednStud, said "you need at least 2500 simulations", and returned plain pooled percentiles. It now recovers the study/individual split, so anStud > 1simulation run from a one-subject event table gives the same answer as the same simulation run from an event table that lists the subjects explicitly (#1308). -
confint(mean="binom", ciMethod=)now reachesbinomProbs(). The option was read out of an undocumentedmethodargument, so the documented spelling was silently ignored and the interval always came back frombinomProbs()'s own default.method=keeps working when it names aciMethod, and is left alone otherwise (#1308). -
confint()counts the individuals in the solved data rather than readingnSubback off the solve arguments, so a data set that carries its own subjects reaches the 2500 individual threshold that puts confidence bands around the percentiles. A solve of 2500 or more subjects supplied as data now returns the banded summary instead of the pooled percentiles (#1308). -
Piping a model's
ini()into another model no longer silently leaves shared random effects behind. Three cases dropped an eta with no error and no message, leaving the destination model on its own initial estimate: when the two models shared exactly one eta, when a shared eta wasfix()ed (it came across unfixed), and when the source model had random effects at more than one level (| occ), which dropped every eta. -
ini()piping of a random effect now honorsunfix()and a| condition.mod |> ini(eta.ka ~ unfix(0.7))changed the estimate but left the eta fixed;mod |> ini(eta.occ ~ 0.2 | occ)stopped withincorrect number of dimensions; and a correlated block,mod |> ini(eta.a + eta.b ~ c(0.6, 0.01, 0.3) | occ), stopped withargument is of length zero. -
A piped correlated block now records its covariance at the level of the etas it links rather than always at
id, so a| occblock no longer lands split across two omegas. -
ini()piping now says when a piped| conditiondoes not match the level the random effect already sits at. Piping an estimate does not restructure the model, so the eta keeps its own level, which used to happen silently. -
A piped random effect keeps its label the way a piped population parameter always has; subsetting the omega used to drop the labels with the estimates.
-
ini()piping no longer adds a covariance between two random effects that sit at different levels. The resulting$omegacould not be assembled at all, so the model stopped as soon as anything asked for it. -
A multi-subject
rxSolve()withnsim/nStud > 1no longer sizes the per-individual solve pool asnsubtimes the number of individual solves it needs. The over-allocation grew with the square of the number of subjects, so a large study either ran out of memory or overflowed the size to a negative number and stopped withnothing to solve-- which is what madenlmixr2est::addNpde()andvpcSim()fail on a large fit (nlmixr2/nlmixr2#412). Results are unchanged. -
A chunked solve (
rxSolve(file=/chunkSize=)) withnStud > 1now simulates the omega uncertainty it was asked for. It previously returned a plausible looking result drawn entirely from the point estimate omega, with the between study variability silently gone (#1252).The draw is made once in the parent, so every chunk shares the same per study omegas -- drawing per chunk would put subjects in different chunks into different studies.
$omegaList/$sigmaListare reported on a chunked solve as they are on a plain one.This changes existing chunked results with
nStud > 1; they were wrong before. Note that reproducing a chunked solve exactly needs both seeds pinned,set.seed()as well asrxSetSeed(), because the omega draw runs on R's RNG while the etas run on rxode2's. -
The
lkj/separationomega strategy no longer hangs on a simulated standard deviation it cannot use (#1255).cvPost()retried a non-finite draw with no bound, but the failure is often not random: with the defaultomegaXform = "variance"the transform is asqrt(), so a negative simulated standard deviation givesNaNon every attempt and the solve span at 100% CPU with no error, no warning and no way to tell a hang from a slow solve. The attempts are now bounded and the error names the cause and points atthetaLower = 0.
- The
iniDfnow tolerates thepriorcolumn thatlotri1.0.5 adds for prior distributions (#1248).testIniDf()/assertIniDf()used to reject every model built with such alotri, and the ini rows that are constructed by hand internally (adding a covariance between two etas, promoting a parameter,linMod()) hard-coded the column list and so failed torbind()with "numbers of columns of arguments do not match". These now match whatever columns theiniDfactually has, so aniniDfwithout the column still works.
-
A variable that is used only as an argument to an adaptive dosing call (
evid_(),bolus(),infuse(),infuseDur(),replace(),multiply(),phantom(),obs()) is now a parse-time error instead of an uncompilable model. These statements consume their arguments as text, so such a variable was never registered and the generated C referenced an undeclared identifier; the failure only showed up as a compiler error that looked like a broken toolchain. The message now names the variable, the argument and the function, and points at the fix (assign it to a model variable first):undeclared 'DOSE' in 'amt' of 'infuseDur()'; assign first: 'amtVal <- DOSE'The check runs once the whole model is parsed, so a variable assigned below the dosing statement still counts as declared (#1231).
-
A wrong-arity
linCmtA()/linCmtB()call (e.g.linCmtA(a,1,1,0), one argument short) now reports a parse-time syntax error instead of segfaulting R.handleFunctionLinCmt()indexed its fixed argument positions without checking how many arguments were actually given, so a short call dereferenced a NULL parse node (#1266).
-
The per-thread
linCmtB()object is a tagged struct rather than an anonymous one named by its typedef, which is what recent clang warns about (-Wnon-c-typedef-for-linkage) since its members are C++ (Eigen matrices, a Stan object). The warning was the macOSR CMD checkfailure. -
A model that fails to build now shows the compiler's own error lines (and only those -- warnings and progress chatter are dropped, and the list is capped by
options(rxode2.compileErrLines=)), followed by how to get the rest (rxode2::rxLastCompile("stderr")for the full compiler output,rxode2::rxLastCompile("c")for the generated C code). The Rtools/C-compiler advice is only given when the failure actually looks like a toolchain problem: a diagnostic naming a source file and line is about the code that was compiled, so the message says the generated C code is at fault and points at the issue tracker, while a driver, linker or loader that fails without reaching the source still gets the setup advice. Previously every failure blamed the toolchain, which sent users off validating Rtools when the compiler had already named the generated-code defect (#1197). -
A model that compiles but will not load reports what the loader said rather than the loader's error replacing the diagnosis, and a build failure found without recompiling (the model's dll was already present) no longer errors with
could not find function ".badBuild"or reports a previous model's compiler output. -
Re-compiling a
linCmt()model from its ownrxModelVars()no longer fails withimplicit declaration of function 'linCmt'. Whether to expandlinCmt()was read from a parser global that only an actual parse refreshes, andrxGetModel()returns model variables it is handed without re-parsing them, so the expansion was skipped -- or run on a model that had nolinCmt()-- depending on what happened to be parsed last. The model itself is asked now, sorxode2(rxModelVars(ui))builds and the result no longer depends on build order (#1227). -
rxLastCompile()now prints its section rules --cli::rule()was called but its result was never messaged -- and takeswhat=to choose which sections are messaged (rxLastCompile("stderr")for the compiler error alone). The returned list is unchanged.
-
ui$modelNameis now always a single character string, as it was always documented to be. It came fromas.character()of the substituted model expression, which returns one element per part of a call, sorxode2(readModelDb("PK_1cmt"))gavec("readModelDb", "PK_1cmt")and an anonymous model function gave a four-element vector including the deparsed body. The name is the tidied first deparsed line of the expression instead: a symbol keeps its name and a call becomes its own text (readModelDb("PK_1cmt")), unless arxModelName()method orrxModelNameLhs()names it better. Names wider than 60 characters are truncated. An anonymous model function names nothing, so itsmodelNameisNULLrather than a piece of its body. Values assigned by other packages (or read from models saved by earlier versions) are also collapsed to a single string on access (#1019). -
A trailing
#comment on anini({})line may now contain a double quote or a backslash. Such a comment is promoted to alabel()call when the model is parsed with its source refs intact, and while the label text was escaped correctly it was then interpolated into the replacement argument ofsub(), which parses backslashes and strips one level. The generatedlabel("fixed to a "small value"")did not parse, so the model failed with a bare syntax error pointing into regenerated text rather than at the offending source line. Because the promotion only runs when source refs are kept, the same model resolved fine without them -- so a package build could be green while a test suite run withkeep.source = TRUEwas red on the identical file (#1195). -
A trailing
#comment on anini({})line keeps itslabel()when the comment itself contains a#, including the common## commentform. The code portion of the line was matched greedily, so on a line with two#it ran on to the last one and left the first sitting in the generated code, where it commented out thelabel()that had just been appended. The label was dropped silently -- the model still parsed and built, it simply lost the label (#1205).
-
A model using the modulo operator
%%can now be estimated.%%was missing from the infix operator tables of theif/elserewriter (rxPrune()) and ofrxOptExpr(), so both emitted it as the prefix call%%(a, b), which is not parsable rxode2. Since every nlmixr2 estimation method runs those two stages, a model that solved fine failed to fit with a syntax error -- blocking%%as the way to write a square-wave or circadian time-dependent parameter. Operands that are not a plain name or number are parenthesized, as the grammar requires (#1229). -
floor(),ceil(),round(),trunc(),sign(),fround(),fprec()andfsign()can now be used with the nlmixr2 estimation methods. They parsed and solved, but symengine'sMathgroup generic has no method for them, so loading such a model raisednon-numeric argument to binary operatorand no estimation method could run it -- which ruled outfloor(time/24), the natural way to write a circadian or square-wave switch. They are now loaded as opaque function symbols (likerxMod()) and are locally constant, so their derivative is 0 at every order.fsign(x, y)transfers the sign ofyontoabs(x), so it gets a real derivative instead:sign(x)*fsign(1, y)inxand 0 iny(#1230). -
Every other parser-known function symengine has no method for now loads too, rather than silently corrupting the model. This covers the special functions (
bessel_i(),bessel_j(),bessel_k(),bessel_y(),logspace_add(),logspace_sub(),fmax2(),fmin2(),gammaq(),gammapDer(),gammapInv(),gammapInva(),gammaqInv(),gammaqInva()) and the derivative helpers rxode2 itself emits (llikNormDmean(),dSELU(),d4GELU(),d2PReLU(),dSwish(), ...). The failed assignment used to be stored as the variable's value and written into the model as<var>=.expr, which failed later with no hint of where it came from -- or not at all, when nothing read the variable. The set is now a deny list of the functions symengine differentiates itself, so a function added to the parser is loadable by default, and an assignment that still cannot be loaded says which variable and why instead of continuing. -
ftrunc(x)builds. Its arity was recorded as two arguments while C'sRf_ftrunc()takes one, softrunc(x)was rejected by the parser andftrunc(x, digits)failed to compile -- the function could not be used at all. -
dSwish()can be used with the estimation methods. Its symengine expansion was missing a closing parenthesis, so the text could not be parsed back and the model failed to load. -
The parser no longer accepts a function it cannot generate compilable C for.
abs0()andpolygamma()exist only betweenrxToSE()andrxFromSE()(abs0(x)is writtenabs(x)/fabs(x), andpolygamma(n, x)ispsigamma(x, n)), andd2PReLU()had no implementation anywhere --PReLU()is piecewise linear, so its secondxderivative is the literal 0rxode2parseD()already returns. Writing any of the three built C with an undeclared function, which rxode2 reported as a code-generation bug and asked the user to file; they now fail at the model text with the usual unsupported function message. Both symengine directions still convert them. -
The description of
fsign()inrxSyntaxFunctionssaidabs(x)*sign(y), which is wrong whenyis 0: the function carries the sign ofyontoabs(x)and treats 0 as positive, so it returnsabs(x)there rather than 0.
-
Every implicit method (
ros4,iem,ros43, ...) and every AutoSwitch composite is much faster, because the analytic Jacobian model is no longer regenerated on everyrxSolve(). The augmented model's text was cached butrxode2()was then re-run on it every call -- a full parse of a model carrying onedf()/dy()line per Jacobian entry, so quadratic in the number of states -- followed by a second pass throughrxSolve.default(). The compiled model is cached instead. On a single subject with seven doses over 0-168 h,"dop853+ros4"drops from 0.0199 s to 0.0132 s on a 1-cmt oral model and from 0.592 s to 0.0234 s on an 11-state PBPK model;ros4on its own drops by the same amount. This was the whole of the composite slowdown reported in #1307, and it applies equally to delay differential equations (whose default method is the composite) and to FOCEi, which solves once per iteration. -
AutoSwitch composites now actually switch.
dop853's stiffness detector is gated on its accepted-step count, which restarts on everydop853()call, and rxode2 calls it once per interval -- so reporting stiffness needed about 64 accepted steps inside one observation interval, which a PK interval never takes. In practice a composite only switched whendop853failed outright, after exhaustingmaxsteps;"dop853+ros4"on a stiff TMDD model returned bit-identical output to plaindop853. The detector's estimate and verdict counters now persist across the intervals of a subject solve, and are evaluated on every accepted step. The same TMDD solve is now 1.7x faster than its own primary because it switches, while genuinely non-stiff models still do not switch at all. -
A composite that switches no longer integrates the interval twice. The stiff secondary continues from the last step the primary completed instead of restarting from the interval start. In the dense path this also fixes an inconsistency: the fallback rewound the state and the delay history but not the observation cursor, so a segment that was supposedly re-solved kept the discarded attempt's observation values.
-
A composite whose primary is not
dop853--"dop5+ros4","bs+ros4","f78+ros4"and the rest -- now switches on the main timeline. Those primaries' drivers ignored the stiff secondary entirely, so the composite ran as the plain primary there while its steady-state intervals did switch. The stiff Robertson problem, which neitherdop5norbscan solve alone, now solves through both composites.dense = TRUEfor a composite is documented and enforced as"dop853+ros4"only, which is what was ever implemented; asking for it on another composite used to silently run the plain primary's own dense stepper. -
The documented AutoSwitch controls do something again.
autoSwitchNonstifftolsets the ratio at which a step is called stiff (the sameeigen_est * h / stability_sizetest Julia's AutoSwitch uses),autoSwitchStifftolsets the same ratio for the optimistic re-probe after a subject has already switched, so lowering it makes stiff mode stickier,autoSwitchStiffFirststarts the solve on the stiff secondary, andautoSwitchSwitchMaxguards the switch back. All five had been left without a consumer when the composite became reactive.autoSwitchDtfachas nothing to mean in a reactive scheme and is now documented as accepted and inert rather than removed. The wait before the primary is probed again now doubles on each probe that fails, so a persistently stiff subject stops paying for probes. -
dop853's stiffness estimate used the signed step size, so on a reverse-time integration it was negative and the detector was silently dead. Steady-state intervals solved withdop853used scalar tolerances while the rest of the same solve used the per-compartment ones, so a sensitivity model -- whose tolerances are scaled per equation -- integrated its steady-state intervals to different tolerances than everything else. -
rxSolve()on a model function'srxUino longer loses what the model'smetablock carries -- most visibly asigma, whose residual variables the solve then rejected as unsupplied parameters.rxSolve.rxUi()is not a registered S3 method, so a call from user code lands onrxSolve.default(), which hands the model back torxSolve()with the wholerxControl()expanded into named arguments; themetablock is only read for options the caller did not name, so naming all of them hid it. The entriesmetasupplies that are still at their default are now left unnamed on the way back. (A call from inside the package, including fromtest_check(), foundrxSolve.rxUi()directly and was never affected.) -
rxSolve(method="indLin")on a model function'srxUinow solves. ThematExp()conversion ran before that same hand-back, so it replaced the ui with a plain model built from the ui's equations and theini()values were never supplied -- the solve stopped asking for the population parameters. A function orrxUiis now converted on re-entry, when the simulation model and its parameters are both in hand. -
A subject's sticky ODE tolerance now stays with that subject. The per-individual
tolFactor(and the looseningnlmixr2estapplies throughatolRtolFactor_()) was folded into the tolerance arrays a thread already held, so it survived into whatever subject that thread solved next and compounded once per subject; every subject after a loosened one was solved at the wrong tolerance, with the result depending on how the subjects happened to be distributed over the threads. Each subject's tolerances are now derived from the solve's baseatol/rtol/ssAtol/ssRtoland its own factor. The factor is also recorded on the subject itself rather than on the thread's copy, so it is no longer lost, and it is bounded as a multiplier instead of being clamped tomaxAtolRtolFactor-- which had made a request to loosen tolerances tighten them on the next solve. A loosening requested when no subject is being solved no longer attaches itself to whichever subject was solved last. -
Modeled duration (
rate = -2) and modeled rate (rate = -1) doses that fall at exactly the same time now solve. Each such dose is expanded into a start/stop pair sharing one time and the solver pairs the two positionally, but the event sort keys on the compartment-bearingevid, so tied doses interleaved (start2 start1 stop2 stop1) and the solve failed with data errors 686/886 (or 797/997 for a modeled rate) -- even for doses into different compartments, which is a legal data set.etTrans()now re-pairs each start with its own stop after the sort, matching on compartment and infusion type; the pass only runs when the data set has a modeled rate/duration dose and it leaves already-correct records in place. The four data-error messages now say what the problem is instead of only naming a number (#1218). -
Fixed an out-of-bounds read of the extra-dose pool while advancing to the first extra dose at or after the current step. The index was bounds checked before it was incremented rather than after, so a subject whose extra doses all precede the step -- reachable with tied modeled duration steady state doses -- read one element past the end and then dereferenced it as a record index, corrupting the heap.
-
A parallel chunked solve (
rxSolve(file=, chunkSize=, parallel=)) no longer fails outright when themiraidaemons load a different rxode2 than the parent is running -- a source checkout, or a library updated underneath a long-lived pool. The whole control list is forwarded to each daemon by name, andrxSolve()rejects an argument it has no formal for, so a parent one version ahead lost every chunk tounused argument. A control the daemons cannot take is now dropped, with a warning naming it and the version they loaded, rather than losing the solve over a setting that version had no notion of. What they can take is asked of the daemon itself, so a matching pool drops nothing. -
rxSolve()'s thread-safety dispatch no longer has a code path that could silently substituteliblsodaRfor the solving method a user explicitly requested. The path was reachable only once a currently-disabled model classification was re-enabled, so it never fired in a release, but everypar_*solver already reseeds its RNG per subject as a pure function of that subject's position, so the swap was never buying the reproducibility it was meant to protect (#1240). -
An event pushed by the model with
evid_()(and thebolus(),infuse(),replace(),multiply(),reset(),phantom()andobs()helpers) now gives the same solution as the identical event written in the data, on every solving method. The ODE methods fired the model body fromdydt()at the start of the next integration interval: the time value was right, but the event was inserted only after the solver had been asked to integrate past it, soliblsoda,dop853andcvodeapplied the jump one observation late andlsodadropped it altogether.evid_()now fires from a single shared point at the record itself -- once per distinct record time, with the pushed event landing in the slot immediately after that record -- so ODE,linCmt()andindLin()models agree with each other and with the explicit event. A model that pushes an event but defines nolhsvariable also compiled to an emptycalc_lhs()and never pushed anything; its body is now emitted. A pushed event that extends the timeline past its original last record is no longer truncated by the densedop853driver, anddense=TRUEis now dropped (with a warning) for a model that pushes: a dense segment integrates across every observation between two key events at once, which cannot honour an event the model decides on at one of those observations. A model that combinesdelay()with a pushed event is now an error rather than silently returning one of two wrong answers:delay()requires the dense output that a pushed event rules out. -
An adaptive dosing helper guarded by
t == <mtime>no longer pushes its dose twice when thatmtime()names a time the event table already contains. The same model written as a function (ini({})/model({})) and as anrxode2({})block disagreed, becauserxSolve()defaults touseLinCmt=TRUEfor a function model: that one was auto-converted to alinCmt()model, and thelinCmt()driver firedevid_()from both its own internal model evaluation and a second pass for the same-time observation. Both forms now push once, and the doubled dose (silent except in the state at the next time point) is gone. -
rxSolve()no longer returns silently wrong, run-to-run varying results when a multi-rowparamsdata.frame (one parameter set perid) is combined withomega = NAorsigma = NA.c()on a data.frame drops the data.frame class and yields a ragged list -- the per-id columns keep their length while the appended zeros have length one -- which was then read out of bounds while solving, so the random effects thatomega = NAfixes at zero were filled from unrelated memory instead. With eight or more subjects this changed the solved values on every solve of identical input, occasionally to non-finite ones. A multi-rowparamsmatrix hit the same problem from the other side:c()dropped itsdim, soomega = NA/sigma = NAfailed outright with "The following parameter(s) are required for solving".omega = NAon a model with no between subject variability (which failed with "invalid 'times' argument") andsigma = NAon a model with no residual error are now the no-ops they should be. -
An
omega/sigmaentry whose variance is zero (sayeta.base ~ fix(0)) is now supplied to the model as a literal zero whenparamsis a matrix, as it already was for a data.frame or a named numeric vector. Such an entry is dropped from the matrix that is simulated from, so a matrixparamsreached the solver without it andrxSolve()failed with "The following parameter(s) are required for solving". A matrix that did supply the item kept its value where a data.frame had it replaced by zero; both replace it now, andzeroVarParamHandle=chooses (see New features). -
A
paramsmatrix that supplies a random effect is now recognized as supplying it, so that effect is no longer simulated on top of the supplied value.rxSolve()decided whetherparamsalready had a random effect withnames(params), which isNULLfor a matrix -- its names are the column names -- so the answer was always "no". The supplied column was silently ignored and a random draw used in its place: witheta.base = 100supplied for every subject, a data.frame gave101 102 103 ...and a matrix gave0.92 1.84 2.67 .... There was no warning, and the values look reasonable unless you know what they should be. -
Supplying a value for one random effect no longer stops the others from being simulated. A supplied effect is dropped from the
omegabefore solving, but the subset that drops it took a single remaining effect down to a scalar, whosedimisNULL, andall(NULL == c(0L, 0L))isTRUE-- so the wholeomegawas dropped and the remaining effect was neither simulated nor supplied (The following parameter(s) are required for solving: eta.b). The matchingsigmacode already guarded this. -
?rxSolveno longer states thatmethod="dop853"cannot solve in parallel. Only the non-reentrant Fortran COMMON block solvers (lsoda,lsode,bdf) are excluded from threading bysolveMethodThreadSafe();dop853has been thread-safe and has honoredcores. Documentation only, no behavior change (#1305).
-
A model reading only some
linCmtB()sensitivity directions (a FOCEi inner model with fewer etas thanlinCmt()parameters) solved every row asNAafter a steady-state dose: the Jacobian columns nobody requested were carried into the next row's state reconstruction as theNAthe buffer starts with, instead of zero. -
A 3-compartment oral
linCmt()model whose depot amount goes negative (a negative dose larger than what is left in the depot) no longer drops the depot from that interval's solution. The depot branch was skipped for a negative amount, which returned the wrong amounts and sensitivities under forward-mode AD and crashed under reverse-mode AD (linCmtSensType="ADr") (#1275). -
A 3-compartment oral model's
linCmtB(which1 = -2, which2 = 6)read (thed/d(ka)sensitivity column) is now registered by the parser; it was rejected as an unknown read, which left that column unfilled. -
linCmtB()gained internal per-subject sensitivity-carry sentinels (which1 = -4to-8) that nlmixr2est uses to keep alinCmt()eta gradient exact when a time-varying covariate makes a parameter differ between rows (-8pins a subject's pass to the full transition advance so an event-modifier jump fed to-7is propagated); they are not reached by a model that does not request them. -
linCmtSensH(the fixed finite-difference step used by theforwardH/centralH/forward3H/endpoint5HlinCmtSensTypeoptions) is now read from its own control slot instead oflinCmtSensType's.rx->sensHwas populated from thelinCmtSensTypecontrol index a second time, so a fixed- steplinCmt()sensitivity used the integer sensType code itself as its step size (e.g.10.0forforwardH) instead of the intended default of1e-4, wildly distorting those finite-difference sensitivities (harmless for the AD sensitivity types, which never readsensH) (#1276). -
rxode2()now refuses to build a model that callslinCmtB(which1 = -3)(the dose-time sensitivity) while itslinCmt()compartments carry more than one distinct modeledalag()-- e.g.alag(depot)driven by one parameter andalag(central)by another.which1 = -3is the derivative wrt ONE delay applied to every dose feeding the linear system; such a model previously solved and silently returned that single-delay answer instead of the true per-compartment sensitivity, which the entry point cannot compute (#1237). -
linCmtB()gained a dose-time (moving boundary) sensitivity,which1 = -3: the derivative of alinCmt()model with respect to a delay applied to every dose feeding it, which is what a modeledalag()on its dosed compartment produces.which2 = -3gives it for the reported concentration,which2 >= 0for the amount in that compartment; chain-rule it withd(alag)/dpfor the sensitivity wrt a model parameter. The system is linear and its whole input is delayed together, so the derivative is exactly-dA/dt-- it matches a finite difference to round-off for bolus, infusion, and steady-state-bolus regimens across one to three compartments, IV and oral. It reportsNAfor a steady-state infusion (its amounts are established analytically, so the infusion rate afterward is not well defined at that index -- #1236) and requires that every dose reaching the linear system share the samealag()(#1119). -
A model that mixes
linCmt()withd/dt()now expands its sensitivities once. ThelinCmt()call has to be resolved before the sensitivity expansion, and the model was re-parsed withcalcSens=afterwards, which differentiated the already-expanded model a second (and, witheventSens=, a third) time. The result carriedrx__sens_rx__sens_<state>_BY_<p>___BY_<p>__compartments nobody asked for and an interleaved compartment layout, which the event-sensitivity map then read as a second-order Hessian block. ThelinCmt()text is now built first and the sensitivities expanded once, from that text. As a consequencesummary()of such a model prints thelinCmt()model as written, without the generatedrx__sens_*equations after it (#1119). -
.rxLinCmt()no longer invents aperipheral1compartment for a one compartment orallinCmt()(nor aperipheral2for a two compartment oral one): the compartment count it decodes includes the depot, and it was read as the number of disposition compartments. An ODE state named like the invented compartment was dropped fromrxStateOde(), so it never got a sensitivity expansion -- itsrx__sens_<state>_BY_<param>__compartment did not exist at all -- and it also raised a bogus "share a name with linCmt() reserved compartments" warning (#1119). -
eventSens="jump"now applies to the ODE compartments of a model that also has alinCmt(). EverylinCmt()model was downgraded to finite differences because the moving-boundary jump for a modeledalag()/f()on alinCmt()compartment is not implemented; the ODE compartments of such a model carry ordinary solved sensitivity compartments and are unaffected by that. The downgrade is now limited to the models that need it: a purelinCmt()model, a reserved-name collision, or a modeledalag()/f()/rate()/dur()on alinCmt()compartment itself (#1119). -
The event-sensitivity jump map is now checked against the true compartment indices rather than assuming them. The runtime injection addresses the sensitivity compartment of (state
k, parameterp) asnState + p*nState + k; a model whose compartments do not lie that way falls back to finite differences instead of having jumps written into the wrong compartment (#1119).
-
The statement form of
ifelse()--ifelse(cond, stmt, stmt), where each branch is a statement rather than a value -- now compiles anywhere in a model. Its handler appendedif (to the code buffers without first clearing the preceding statement's text, so the generated C ran the two together (kin=3if (t<2) {) and only a model whose first statement was anifelse()compiled. The construct now emits and normalizes exactly like the equivalentif (...) {...} else {...}, so it round-trips throughrxNorm()and translates for symengine derivatives (sensitivities, FOCEi) the same way (#1211). -
rxCompile()now re-parses the model it is handed whenever the parser's current model is a different one. Code generation reads the parser's global model state, and the old guard only checked whether some model was loaded, so a re-compile requested while an unrelated model was parsed wrote that other model's C under this model's name and handed back its model variables. Building a model withrxode2()never hit this (it parses, then compiles immediately), but re-loading one whose.sois gone did -- as when a saved fit is restored in a new session, since its DLL lived in the original session'stempdir(). Such a fit came back solving a different model, e.g. a restored SAEM fit failing with "The following parameter(s) are required for solving: eta.v, eta.cl". -
Event ("jump") sensitivities now compile when a dosing modifier (
dur(),f(),alag(), ...) depends on more than one estimated parameter. Each such parameter contributes its own assignment line to the same generated buffer, but the rewrite of nlmixr2's indexedTHETA[n]/ETA[n]to the codegen locals_THETA_n_/_ETA_n_only collected the indices used by the first line, so an index appearing only in a later line survived as raw symengine array syntax and the model failed with "'ETA' undeclared". This hit any model with, say, a food-effect duration built from two etas, whether or not the parameters were mu-referenced (#1196).
-
rxOptExpr()no longer fails on apast(state, tau)whose delay duration is an expression rather than a name or a number (past(G, exp(lT)),past(G, tau*2)), which raisedunsupported lhs in optimize expressionand printed the duration into the middle of the progress bar. This madeoptExpression=TRUEunusable for such a delay differential equation; it now optimizes, and the duration follows the same common subexpression itsdelay()terms do, so the history stays matched to them. -
A generated delay differential equation model (
rxode2(..., calcJac=TRUE),calcSens=, or an nlmixr2 estimation model) now resolves thepast()delay duration the same way it resolves the history itself. A duration written as an intermediate (T <- exp(lT)) was emitted verbatim while everydelay()had its duration inlined, so the generated model named a duration nodelay()used any more andrxSolve()rejected it withduration 'T' does not match any delay(...). This also covers a duration or a history written withTHETA[n]/ETA[n], as every mu-referenced model is: they were left unresolved, and an unresolved history additionally emitted no per-parameter sensitivity pre-history at all.
-
meOnly()/indLin()no longer write past the end of their buffers when a downstream package sets a per-individual effective state count (setIndNeqOverride()). Those buffers were sized by the effective count while the model-generatedME()/IndF()/calc_jac()bodies always index by the compiled state count, so a shortened count overran them -- quadratically forME(). The generated code is now called through a full-size buffer and the leading effective block copied back; with no override, which is every path rxode2 itself takes, the calls and the numerics are unchanged. -
rxToIndLin()-- and thereforerxSolve(method="indLin")-- now converts a model that mixeslinCmt()withd/dt(). It walked$state, which counts thelinCmt()pseudo-compartments (depot,central,peripheral*); those have nod/dt()behind them, so it emittedcmt()/indLin()lines for derivatives that do not exist -- one of them the literal R variable name.tmp-- and the generated model did not parse. Only thed/dt()block is converted now; the solved compartments stay with the analytic solver and are copied back after each step. A term reading alinCmt()goes to theindLin()forcing rather than into a rate constant, since a solved compartment moves within the matrix-exponential step, and such a forcing takes the iterating path so the driver refines it. -
A
df(<state>)/dy(<state>)Jacobian entry may now referencelinCmt(). AlinCmt()call retyped the whole statement, so the entry lost its Jacobian routing and was emitted intodydt(), where__PDStateVar__does not exist: the model failed to compile. For the same reason amatExp()rate constant orindLin()forcing built from alinCmt()concentration now reaches theME()/IndF()functions instead of reading a stale value. -
rxSensMatExp(calcSens3=)now carries theindLin()forcing at third order, ascalcSensandcalcSens2already did. Only the rate-matrix cross terms were generated, so third-order sensitivities of a nonlinear model were short every term the forcing contributes; the warning that said so is gone. -
The
Al-Mohymatrix exponential evaluated the wrong Pade numerator below degree 13. The coefficients depend on the degree, and the routine read a fixed table -- the degree-13 row -- and truncated it, which is not the degree-p numerator. The answer stayed convergent but only to a few1e-12where every other backend reaches machine precision, and only against an exact solution is that visible. The row is now built for whichever degree was selected. -
The
Al-Mohymatrix exponential returned a wrong answer for a very large matrix norm. The squaring count was returned as the factor2^sin anintand clamped so it could not overflow, but clamping caps the scaling while leaving the norm untouched, so degree-13 Pade ran far outside its range and produced a plausible finite number: a one-compartment model with a rate constant of1e20returned5.1e-08for a quantity that underflows to zero. The squaring count is now carried as a count. -
rxSolve(indLinMatExpType=)now defaults to"Al-Mohy"rather than"expokit". With the degree bug below fixed, all four backends agree to solver tolerance and take the same steps on every problem tested, and"Al-Mohy"is the cheapest per exponential: about 4-5% on a Michaelis-Menten population and 34% on a stiff van der Pol one, where an exponential-Rosenbrock step rebuilds its operator every step and the exponential cache cannot help. On a linear model the difference is unmeasurable, the cache serving nearly every call. Results move in the last digits, as any change of exponential kernel does; passindLinMatExpType="expokit"to keep the previous one. -
rxSolve(indLinMatExpType="Al-Mohy")chose its Pade degree and its scaling inconsistently, which could return a silently wrong answer or a solve that never finished. The scaling came from the Al-Mohy-Higham threshold table, whose entries each belong to one specific degree, while the degree itself came fromindLinMatExpOrder(default 6) -- so any matrix with a 1-norm up to the table's largest threshold, 5.37, was evaluated at degree 6 with no scaling at all where the table calls for degree 13. Both are now taken together from the norm, as thetaylorbackend already did. A two-compartment linear model returned1.8e-06against about1e-11for every other backend, and one van der Pol subject atmu = 95.7866under an exponential Rosenbrock step ran for over 390 seconds -- a bad exponential can make the error estimate unsatisfiable, so the step controller shrinks the step without limit instead of failing -- where the other backends took 0.03 s. Both now agree with the other backends, and on a 50-subject stiff populationAl-Mohygoes from not completing in 418 s to 0.92 s, the fastest of the four. ConsequentlyindLinMatExpOrderno longer applies toAl-Mohy; it still applies toexpokit. -
rxSolve(<function or rxUi model>, method="indLin")failed with "Can only parse scalar data". With the defaultuseLinCmt=TRUEthe ODE was first rewritten intolinCmt(), leaving a model withlinCmt()pseudo-compartments and nod/dt()for the matrix-exponential conversion to work from. That rewrite is now skipped whenmethod="indLin"is requested, so such a model integrates its own rate matrix rather than being replaced by the analytic solution. -
A steady-state infusion (
ss=1orss=2with arate) gave a diverging solve undermethod="indLin". Its solver was the only one that never drained the pending-dose queue, which is where the infusion's off record is held, so the steady state itself was found correctly and the infusion was then left running for the rest of the timeline. Steady-state boluses and ordinary (non-steady-state) infusions were unaffected. -
method="indLin"is substantially faster. The ODE-to-matExp()conversion ran on everyrxSolve()call although it is a pure function of the model, and cost several times the solve it was preparing for; it is now done once per model (options(rxode2.indLinConvCache=FALSE)restores the old behaviour). The matrix exponential itself was recomputed on every fixed-point pass even though the rate matrix cannot change between them, and identical exponentials are now reused (RXODE2_INDLIN_NO_EXP_CACHEdisables this). Together these are several times faster on a nonlinear model and more on a linear one; no result changes. -
indLinRichardsonextrapolatedindLinIteration="exprb32"with the factors for a second-order base step, which exprb32 is not -- it is third order, so each level took its leading term down by a constant instead of removing it, and the step was sized from an estimate a whole order off. Asking for a level therefore made the answer worse: on a Michaelis-Menten model at1e-8,indLinRichardson="always"delivered3.7e-6where"never"delivered1.0e-7. The tableau now takes both the base order and how far a level advances it from the scheme, so"always4"is1.2e-8for a ninth of the steps"never"needs. Onlyexprb32is affected: it is neither the default nor reachable from"auto", which never raised its level. -
rxSolve(indLinForcing=)chooses howmethod="indLin"carries theindLin()forcing across one relinearization step. It was folded into an augmented column exactly as a constant infusion rate is, so it was frozen for the whole step."ramp"(the new default) evaluates it at both ends of the step and integrates the line between them exactly -- the phi2 term -- with the rate matrix taken at the step midpoint;"constant"is the previous scheme, which reaches the same second order by averaging a start-linearized and an end-linearized answer. It applies to the"picard"and"newton"schemes; the exponential Rosenbrock ones never freeze the forcing.Only the endpoint value moves with the iterate, so the rest of the step is built once and a pass costs a forcing evaluation and a matrix-vector product rather than a matrix exponential. The converged ramp step is symmetric, so its error expands in even powers of the step alone and
indLinRichardsonnow removes two orders per level instead of one -- third order becomes fourth, fourth becomes sixth, fifth becomes eighth. That is where the difference shows up: under the defaultindLinRichardson="auto"a nonlinear model is several times to a hundred times more accurate at the same tolerance for the same or fewer steps, while with no extrapolation the two are a wash, both being second order there. -
rxSolve(indLinJac=)chooses where the forcing Jacobian comes from whenmethod="indLin"needs one, which is only under"newton","exprb"and"exprb32"-- Picard needs none, so a non-stiff model under the default scheme never forms one."symbolic"uses the model's own analytic Jacobian, which thematExp()conversion already emits asdf()/dy()lines, and costs no extra forcing evaluations;"fd"central-differences the forcing at2nevaluations."auto"(the default) takes the symbolic one when the model carries it and falls back to finite differences otherwise, which is what happens abovegetOption("rxode2.indLinJacMaxStates")states where the emission is skipped.On cost the two are a wash at compartmental sizes -- within about 25% of each other either way from 3 to 16 states, with no consistent ordering, and the symbolic emission adds a fraction of a second once at model build. The reason
"auto"prefers symbolic anyway is exactness rather than speed: an exponential Rosenbrock step's order conditions assume the Jacobian is exact, and on a stiff van der Pol the symbolic one delivered a smaller error for the same work. -
rxSolve(indLinIteration="exprb32")adds the Luan-Ostermann third-order exponential Rosenbrock pair. Its embedded second-order member is"exprb"itself, so the two differ by a computable quantity and it sizes its step from that rather than from the extrapolation column -- which is what"exprb"has to use and why"exprb"is held at fourth order. It is NOT the default and is not selected by"auto": measured at matched delivered accuracy it wins only on a stiff problem at a loose tolerance, by about 1.2 to 1.7 times, and loses elsewhere, badly so on a non-stiff population. The reason is the cost of the third phi function, which needs an augmented matrix three rows wider than the plain step; at the small dense systems compartmental models produce, widening the exponential costs more than the extra order saves. -
rxSolve(indLinIteration=)chooses howmethod="indLin"solves each relinearization step:"picard"(the previous and only behaviour),"newton", or"exprb", an exponential Rosenbrock step that does not iterate at all. Which is cheapest depends entirely on the problem -- on a non-stiff model the iteration never limits the step and Picard is cheapest, while on a stiff one it is the only thing limiting it -- so"auto"(the default) starts on Picard and switches only once steps are actually being cut for non-convergence. A model that never needs a Jacobian therefore never forms one. On a van der Pol oscillator integrated over a full relaxation period at matched accuracy this is about 39 times faster than Picard atmu = 100(593 relinearizations against 45,913) and about 426 times faster atmu = 1000(581 against 1,001,968), which takes a full cycle at that stiffness from impractical to routine; a Michaelis-Menten model is left on Picard and unchanged. With both schemes given their best extrapolation level, that division holds: Picard is ahead on a non-stiff model at working tolerances and the exponential Rosenbrock step is ahead on a stiff one, and at a delivered error of 1e-8 on a non-stiff model."exprb"runs at fourth order or above, since its error estimate comes from the extrapolation column and the third-order one is not reliable enough to size a step from. -
method="indLin"extrapolates further when it pays. Each relinearization step could previously be raised from second to third order by running it also at half length; it can now use a Romberg column of up to four entries (h,h/2,h/4,h/8) for up to fifth order, at 3, 7 and 15 fixed-point solves per step.indLinRichardson="auto"(the default) raises the level as the step the controller settles on crosses each break-even."always4"and"always5"force the new levels. On a 200-subject Michaelis-Menten solve this halves the time atatol=rtol=1e-8, and on a single subject at1e-12it is over seven times faster than the third-order step. -
indLinRichardson="auto"keeps the extrapolation level it has earned for the rest of the subject, instead of dropping back to second order at every observation and re-earning it. A step that only needs a few relinearizations never reached the break-even, so a model observed at a dozen times ran most of its profile at second order however low the break-even was set: on a 200-subject Michaelis-Menten solve the default took 0.626 s to reach a delivered error of 1e-4 where forcing the fourth-order column took 0.098 s. It is now 0.112 s, and 0.341 s rather than 0.646 s at 1e-6. The break-evens themselves are also measured rather than derived, and differ between the fixed-point and exponential-Rosenbrock steps, whose costs per level differ. A model whose forcing reads no state is unaffected: the matrix exponential is already exact for it and there is nothing to extrapolate.Two consequences for anyone reading step counts. A loose tolerance now does use extrapolation -- it turns out to pay there too, taking fewer steps than the second-order path rather than the same number -- and the delivered error at a loose tolerance is much smaller than before, so a ratio of errors across a tolerance sweep is no longer a way to read off the order of the default path. Use
indLinRichardson="never"for that. -
rxSolve(indLinMatExpType="taylor")adds a Taylor scaling-and-squaring matrix exponential, which needs no linear solve; its degree is chosen per call from the norm. It is as accurate as the default"expokit"on every problem tested, including a linear system where"Al-Mohy"at its default order is six orders of magnitude worse. The default is unchanged: profiling puts all of LAPACK at roughly 3% of a solve, so avoiding the linear solve does not pay on nonlinear problems. -
$counts$dadtand$counts$jacreport the matrix exponentials computed and reused for amethod="indLin"solve. Both counters were previously unused on this path. -
method="indLin"no longer uses the R API from inside the parallel solve. The Al-Mohy matrix-exponential backend took its workspace fromR_alloc, and the default expokit backend warned throughRWarnon a singular Pade denominator; neither is safe from a worker thread. The singular case also used to continue with an unfinished matrix, and now reports and returns zeros. -
method="indLin"no longer throws from inside the parallel solve. Two code paths in the inductive-linearization solver raised an R-level error from a worker thread, which crashes the session rather than reporting an error; both now report through the usual per-subject error flag. -
An
indLin(<state>) <- <expr>forcing that references a compartment is now evaluated at that compartment's current value. The generated forcing function took no state vector, so the compartment kept itsNA_REALdeclaration and any state-dependent forcing (e.g. Michaelis-Menten elimination,indLin(central) <- -vmax*central/(km+central)) solved toNAundermethod="indLin". A forcing that references no state is unchanged. -
method="indLin"iterates again, so it is inductive linearization rather than one relinearization perhmaxsubstep. Within each substep the matrix and the forcing are rebuilt at the latest iterate while propagation restarts from the substep's starting state, until the states reported byrxModelVars(m)$indLin$wIndLinstop moving to withinatol/rtol. Plain Picard iteration only barely contracts once the substep is comparable to the forcing's own time scale -- a Michaelis-Menten forcing with no linear elimination sits right at the stability boundary, oscillating for ~1e5 passes -- so each step is relaxed by a secant estimate of the iteration's contraction ratio. Relaxation does not move the fixed point, so the converged answer is the undamped one. Models with no forcing, or with a forcing that reads no state, keep the single-pass path and are unchanged. -
Converting an ODE model to
matExp()form (rxToIndLin(), and thereforerxode2(..., indLin = TRUE)andmethod="indLin"'s auto-conversion) now puts the nonlinear part of a right-hand side into anindLin()forcing instead of into a rate constant. A rate constant that reads a compartment is not a rate constant -- the matrix exponential assumes the rate matrix is constant in the states -- and burying the nonlinearity there meant the solver could not iterate it. Michaelis-Menten elimination now converts toindLin(central) <- -vmax*central/(km + central)with an empty rate matrix rather than tok_central_output = vmax/(km + central). This also removes a rate constant that was singular when the compartment was empty. Because these models now reach the iterating solver path, they are far more accurate: a one-compartment Michaelis-Menten solve that was about 70% off at the default settings is now within about 0.01%.rxIndLinStrategy()andrxIndLinState()no longer affect the conversion, since no way of factoring a multi-state product yields a state-free rate constant; both are kept so existing code keeps working. -
rxSensMatExp()(rxToIndLin(calcSens=)) splits the system the same way. It used to take its rate matrix from the full Jacobian, so for a nonlinear model every rate constant read a compartment and the propagated primal wasA(X).Xrather thanf(X). The nonlinear part now rides in anindLin()forcing, and each sensitivity compartment gets its own forcingd(f)/dp + (df/dy).S^p, at first and second order. A state-free input term (d/dt(x) = k0 - ke*x), which the Jacobian never saw, is carried too instead of being dropped. Michaelis-Menten forward sensitivities now match the ordinary ODEcalcSenspath, and since the rate matrix is constant the matrix exponential is cached across substeps. A rate constant that reads a compartment is a parse error for a sensitivity model as well now. Third-order sensitivities do not yet get a forcing contribution. -
eventSens="jump"gets the right event-time (alag) jump sensitivity on amatExp()model that has anindLin()forcing. Thereplace()/multiply()jump rows need the right-hand side at the pre-event state, which was taken from the model Jacobian dotted with the state -- correct only while the whole right-hand side is the rate matrix times the state. With a forcing it is short by the forcing's own contribution, which on a Michaelis-Menten model put those sensitivities about 3.6% out. It now comes from the rate matrix and the forcing function directly. This also affects hand-writtenindLin()models, not only the onesrxSensMatExp()generates. -
rxSolve(indLinRichardson=)Richardson-extrapolates eachmethod="indLin"relinearization step, raising it from second to third order: the step is run once whole and twice at half length, and since a second-order step has a quarter the error at half the length, the two answers together cancel it. That costs three fixed-point solves per step instead of one, so it only pays once the tolerance is tight enough that taking far fewer steps outweighs it."auto"(the default) decides per interval: after the first accepted step it compares the step the controller settled on against what is left of the interval, and switches when finishing at that step would take more than 27 of them -- the break-even point, since a second-order step needingNsteps becomes a third-order one needing aboutN^(2/3)at three times the cost each."always"/TRUEand"never"/FALSEforce the choice. On a Michaelis-Menten model the switch-over lands at aboutatol=rtol=1e-5; at1e-8"auto"takes 544 steps where the second-order step takes 12,865. -
rxSolve(indLinStepSearch=)andrxSolve(indLinMaxIter=)control the fixed-point iterationmethod="indLin"runs inside each relinearization step.indLinStepSearch="secant"(the default) estimates the iteration's contraction ratio from the last two residuals and relaxes by it, which costs nothing extra and is what makes an oscillating iteration converge at all;"exact"spends one more matrix exponential per iteration to locate the residual-minimizing factor in closed form;"none"is plain, undamped Picard. All three converge to the same answer -- relaxation does not move the fixed point -- so the choice trades iterations against work per iteration; on a Michaelis-Menten model the default is about five times faster than"none".indLinMaxIter(default 20) caps the iterations per step; running out is not an error, since the iteration contracts in proportion to the step and the solver reads it as a step that is too long. -
A
matExp()rate constant that depends on a compartment is now a parse error rather than a silently invalid model. The matrix exponential is only correct when the rate matrix is constant over the step, so ak_from_tothat reads a state breaks the method's central assumption; the error names the constant and the compartment it reaches and points atindLin(), which is where a state-dependent term belongs and where the solver can iterate it. This applies to sensitivity models built byrxSensMatExp()as well. -
method="indLin"chooses its own relinearization step for models with a state-dependentindLin()forcing, instead of subdividing each interval evenly byhmax. The forward answer (matrix built at the step's starting state) and the converged backward answer bracket the truth symmetrically, so their difference is a local error estimate that costs nothing extra; the step is then chosen from it the same way the other adaptive solvers choose theirs.atol/rtolandmaxstepsnow control the accuracy of these models andhmaxonly bounds the step. An iteration that will not converge is treated as a step that is too long and is retried shorter rather than reported, so stiff forcings that previously failed outright now solve; non-convergence is reported only once the step or the step budget runs out.$counts$slvrreports the relinearization steps actually taken, where it used to read zero. One consequence worth knowing: as with every adaptive method, the solution is now a piecewise function of the parameters, which adds a little noise to finite-difference gradients taken through it.Each step also advances on the average of the two answers the error estimate is built from, whose leading errors are equal and opposite, so what is propagated is second order where either alone is first. This costs nothing -- both are already in hand -- and it is what brings the step count down: the error now falls roughly in proportion to
atol/rtolrather than to their square root, so the work needed for a given accuracy grows like1/sqrt(error)instead of1/error. On the Michaelis-Menten model above, matching the accuracy the old scheme delivered at its default now takes about a twentieth of the steps, and the gap widens the more accuracy is asked for.The forward answer is evaluated at the step's starting time as well as its starting state, so that it and the converged answer really are the two ends of one quadrature. Evaluating both at the step end cancels the state error but leaves the explicit-time error, which silently dropped any forcing that reads
tback to first order: on a Michaelis-Menten model with anexp(-t)input the error atatol=rtol=1e-9falls from 4.6e-03 to 1.1e-07.
-
A saved solver state now round-trips the
indLin()convergence set (op->indLin, fromrxModelVars()$indLin$wIndLin). Only its length was written, so restoring a state for a model with anindLin()forcing left the set itself empty and the relinearization iteration indexed a null pointer. -
A saved solver state now round-trips the initial-condition and scale vectors it claims to. Their lengths were taken from the distance to the next pointer in the
gsolveslab rather than from the vectors themselves, so they spanned the interveninglhsand tolerance blocks and no state could be restored at all:rxLoadState()failed with a size mismatch for every model. The two lengths now travel with the state, which is what the format version is bumped to 3 for; a state written by an earlier version is rejected with a message asking for it to be re-saved.
- On Windows,
STAN_THREADSand the TBB link are kept when building againstRcppParallel>= 6.2.0, which shipstbb.dll/tbbmalloc.dllwith the package again.configurenow decides whether to strip the TBB flags by looking for the TBB library inRcppParallel'slibdirectory rather than by the shape of the-Lflags it emits, so the TBB-less build introduced in 5.1.6 is used only withRcppParallel6.0.0--6.1.1, which shipped no TBB library on Windows. (The 5.1.6 release notes had this backwards:RcppParallel6.2.0 restored the TBB library on Windows rather than dropping it.)
-
Added the event ("jump") sensitivity shape to rxode2's linked function-pointer API, so a downstream package can install a model's shape from C++ without an R round trip:
rxode2EventSensLoadFull()(all six dims, where the olderrxode2EventSensLoad()omittednParam3/useCalcJac),rxode2EventSensGetDims()/rxode2EventSensSetDims(),rxode2EventSensSetActive(),rxode2EventSensDeactivate(), andrxode2EventSensShapeSize()/rxode2EventSensShapeSave()/rxode2EventSensShapeRestore(), which snapshot and reinstall a whole shape (dims plus the model's dosing-derivative function pointers) through a caller-owned opaque buffer. This lets several peer models with different shapes be solved through one shared solve pool, installing each batch's shape and restoring the previous one afterwards. -
Added
setIndCmt()to the function-pointer API, the writer counterpart ofgetIndCmt(), so a downstream package can re-base the per-observationCMTcovariate without reaching intoop->cmtCov/ind->cov_ptrby field.getIndCmt()reports a missingCMTasNA_INTEGER, distinct from the1it returns for a model with noCMTcovariate at all (where every observation really is compartment 1), so a caller re-basing the column can leave missing rows alone.
- The compiled-model cache key now includes
eventSensCode, so two builds of one model whose generated C differs -- event sensitivities on vs off -- no longer share a.c/.sopath in the rxode2 cache directory. Previously the second build overwrote the first while any model object created earlier kept resolving its entry points by name, so it silently began executing the other variant: the declaredlhswidth was unchanged but most slots were never written, andrxSolve()returned whatever was left in the buffer. A model with no event-sensitivity code keeps exactly the prefix it had, so no existing cache entry is invalidated (#1171).
- The suggested
xgxris now required to be>= 1.1.6. Itsxgx_scale_x_log10()/xgx_scale_y_log10()return theggplot2scale itself from that version on, rather than a length-one list wrapping it.
- Fixed the Windows build against
RcppParallel6.2.0, which no longer ships the TBB library there (6.0.0 still built).configurealready dropped the-ltbb/-ltbbmalloclink flags when they are unavailable, but still compiled with-DSTAN_THREADSand-DRCPP_PARALLEL_USE_TBB=1, which pullsstan::math'sad_tape_observer(atbb::task_scheduler_observer) into the objects and left undefined references totbb::detail::r1::observeat link time. Those defines are now dropped together with the link flags,stan-math'sinit_chainablestack.hppis kept out of the build, and the main thread's AD tape -- which that observer would otherwise have created -- is constructed insrc/linCmt.cppinstead (by Jeroen Ooms).
-
Fixed heap corruption when
simeta()/simeps()resample inside a solve. Both go throughsimvar(), which reseeded its threefry stream withgetRxSeed1(); unlessrxSetSeed()had been called that draws from R's own random number generator, which allocates R objects and can trigger a garbage collection. Doing so from an OpenMP worker thread corrupted R's heap, and the session then failed later in an unrelated place (cannot get data pointer of 'NULL' objects,'rho' must be an environment,corrupted double-linked list, or a segfault). The in-solve resample now draws from a per-thread engine seeded on the main thread and touches no R API. -
The
simeta()/simeps()resample no longer replays the simulated parameters. Its engines are keyed off a threefry draw rather than off therunif()-derived seed handed out at solve setup, whichrxSolve()goes on to reuse for the simulatedomega/sigmadeviates; a resampledetacould therefore come out exactly equal to another subject's simulatedeta.
-
library(rxode2)is faster..onLoad()no longer callsrequireNamespace()on the suggested packages (pillar,tibble,arrow,dplyr,nlme,units,digest) before registering their S3 methods. The registration helper already installs anonLoadhook when the other namespace is not loaded yet, so the eager loads only added startup cost; the methods are still registered at the same point in time from the user's perspective. -
rxControl(sigdig=)now derives the ODE solver tolerances with one solver-independent formula -- the same for stiff, non-stiff and auto-switching solvers. Thertolexponent ISsigdigandatolsits three orders below it:rtol = 10^(-sigdig)andatol = 10^(-sigdig-3). The sensitivity tolerances match the main solve (rtolSens = rtol,atolSens = atol), since gradients and covariances are built from them, and the steady-state tolerances run one order looser (ssRtol = ssRtolSens = 10*rtol,ssAtol = ssAtolSens = 10*atol). This matches hownlmixr2estderives solver tolerances from its optimizationsigdig, so the samesigdigmeans the same thing whether it is used for estimation or for a plainrxSolve().sigdigremainsNULLby default and continues to have no effect unless you pass it, so solves that do not namesigdigare unchanged.Two notes for callers who do pass it. First, the mapping is keyed to
sigdigas a request for that many significant digits, which for smallsigdigis looser than what the previous symmetricatol = rtol = 0.5*10^(-sigdig-2)gave: atsigdig = 4,rtolmoves from5e-7to1e-4, which is also looser than the1e-6defaultrtol(atolmoves the other way, from5e-7to1e-7). If you were usingsigdigto tighten a solve, raise it or setatol/rtoldirectly. Second, each tolerance is resolved independently and only when you did not supply it, so an explicitatol/rtoloverrides the main solve but does not propagate to the sensitivity or steady-state tolerances -- set those directly if they should change too. -
The SUNDIALS public headers are now vendored into the package (
src/sundials_inc/) alongside the already-vendored SUNDIALS C sources, and theLinkingTo: sundialrdependency has been dropped. This guarantees the vendored sources always compile against headers from the same SUNDIALS release, instead of silently drifting when sundialr updates its bundled SUNDIALS (#1155). The vendored include is injected viaPKG_CPPFLAGSso it precedes the LinkingTo include flags; otherwise the older SUNDIALS copy bundled inside StanHeaders would shadow it. -
rxSerialize()now writes the base R types only ("xz","bzip2","base");qs2is no longer a write format.rxDeserialize()still readsqs2/qdata-serialized data and base91-encoded strings, so objects stored by earlier versions remain readable. Test data was converted from.qs2to.rds.
qs2moved toImports.rxDeserialize()used it without declaring it anywhere, and because the call sites named the package as a string, the dependency was invisible toR CMD checkas well. Environments that build their library from the declared dependency graph could therefore end up withoutqs2and fail to read objects stored whileqs2was an allowedrxode2.serialize.type-- for example theorigDataslot of fits saved by earlier versions.qs2is now only ever read, never written.
-
The first and second derivatives of the Yeo-Johnson transform (
rxTBSd()andrxTBSd2()) had the wrong sign for negative values whenlambdawas exactly2. Thereyj(x) = -log(1 - x), so the derivatives are1/(1 - x)and1/(1 - x)^2, both positive; the special case returned them negated, which also contradicted the general formula's limit and made the derivative discontinuous inlambdaat2. Since Yeo-Johnson is monotone increasing, its first derivative must be positive everywhere. -
Review of the fix above found further errors in the same transform family (all pre-existing, none introduced by that fix):
rxTBSd2()returned a wrong second derivative for thelogittransform (an algebra error in the closed form) and for the composedlogit + yeoJohnson/probit + yeoJohnsontransforms, where the chain rule used the first Yeo-Johnson derivative in place of the second and dropped the inner-transform curvature term.rxTBSi()did not invert the composedlogit + yeoJohnson/probit + yeoJohnsontransforms: it applied the forward Yeo-Johnson transform (or skipped it entirely) instead of the inverse, sorxTBSi(rxTBS(x))did not returnxforlambda != 1. This affected simulation back-transforms of those error models.- The
lambdagradient of the transform log-Jacobian (powerDL, used by estimation routines) was wrong on the negative Yeo-Johnson branch (-log1p(x)instead of-log1p(-x),NaNforx < -1), returned a spurious0at exactlylambda == 1forboxCox/yeoJohnson, was missing theprobit + yeoJohnsoncase (returnedNA), and returned a spuriouslog(x)(instead of0) for the lambda-freelnormtransform. The log-Jacobian itself (powerL) clamped the wrong term in itslogitguard, giving an unprotectedlog(0)at the upper bound. - For
boxCox/lnorm,rxTBSd()andrxTBSd2()returned the clamp constantsqrt(.Machine$double.eps)itself forxat or below the clamp instead of clampingxand evaluating the derivative formula, making the derivatives discontinuous (and ~15 orders of magnitude too small) at the boundary. The clamp now feeds the usual formula, matching how every other transform in the family handles the guard.
- The symbolic derivatives of the relational operators (
>,<,>=,<=) are now centered on the discontinuitya == b: theatanh(2*tol - 1)shift that placed the smoothed nascent-delta bump ata - b ~ +/-0.46was removed. Since the forward pass evaluates relationals as hard booleans, the shifted bump gave sensitivity/exact-gradient consumers (e.g. FOCEI's analytic gradient paths) a spurious derivative in a band next to the threshold; the centered rule makes the derivative consistent with the forward value. This also makes the first derivatives ofabs(),min(), andmax()exact away from the boundary (#1159).
-
Fixed heap corruption when
OMP_NUM_THREADSis set below the number of cores a solve asks for -- as it is on CRAN check machines, which setOMP_NUM_THREADS=2. The extra-dosing pools were sized once when the package loaded, fromomp_get_max_threads()(which honorsOMP_NUM_THREADS), but they are indexed by the solving thread id, which is bounded byop$cores;rxSolve(cores=)overridesOMP_NUM_THREADSthrough OpenMP'snum_threadsclause. Every thread past the firstOMP_NUM_THREADStherefore wrote off the end of those arrays, corrupting the heap and crashing the session later in an unrelated allocation. The pools now grow to coverop$coresat solve setup, like the other per-thread pools. -
Fixed an out-of-bounds thread index that could segfault a solve. The internal thread id used to slice the per-thread solving buffers was not bounded by the number of threads those buffers were allocated for (
op$cores). A larger id read past the end ofgInfusionRate[]-- an array of pointers -- and the resulting garbage pointer crashediniSubject(); the flat per-thread arrays were silently overrun in the same way. The id is now clamped to the last valid slot, matching whatrx_get_thread()already did. -
Fixed a cross-subject leak in batched multi-subject
linCmt()solves: the per-thread inter-event amount buffer was never cleared between subjects, so withcores < nSubevery subject after the first on a thread could start from the previous subject's compartment amounts (surfaced by a modeledalag()) (#1153; by Hidde van de Beek). -
delay()/past()models containing anif/elseblock failed to solve withunexpected 'else': the DDE helpers parsed therxNorm()text directly, which puts}andelseon separate top-level lines; the normalized text is now parsed wrapped in a{ }block. In addition, apast()history inside anif/elsebranch is now rejected with a clear error (it was invisible to validation), and delay-duration root-variable resolution now sees assignments made insideif/elsebranches (#1151).
-
ev$idon an event table now returns the per-rowidcolumn (matchingas.data.frame(ev)$id) instead of the unique subject ids, so idiomatic subsets likeev[ev$id == 3, ]and per-subject assignments likeev$wt <- 50 + 20 * ev$idno longer silently recycle a short vector; the unique ids remain available viaev$env$ids.[.rxEtnow errors on a logical row index whose length matches neither 1 nor the number of rows, and columns assigned withev$col <- value(new covariates as well as previously hidden canonical columns such ascmt) now round-trip throughas.data.frame(ev)(#1154). -
Columns assigned explicitly on an event table (
ev$wt <- 70) are now shown in the tibble printed byprint(ev), inev$get.EventTable(), and in the compressed preview printed forev$get.dosing()/ev$get.sampling(), matchingas.data.frame(ev). They were kept and used when solving, but never displayed, so they looked like they had disappeared (#1154). -
ev$get.dosing()andev$get.sampling()now print the same columnsprint(ev)does regardless of how the event table is stored internally. Previously an un-grouped table printed every internal column, including hidden ones such aslow/high/durand covariates that only rode along with an imported data frame, while a compressed one printed only the shown columns. Every column is still present on the returned data frame for programmatic access, a column added or renamed on the returned frame still prints, anddplyrverbs turn it back into a plain data frame the way they already did forrxEt-- including the column verbs (select(),relocate()), which subset with[rather than going throughdplyr_reconstruct(). -
Explicitly assigned columns now survive a round trip through a data frame.
as.data.frame()tags them in arxEtExtraColsattribute thatet(),as.et()and$import.EventTable()/$importEventTable()read back, soet(as.data.frame(ev))keeps showingwtinstead of demoting it to a hidden imported covariate. A data frame built by hand carries no tag, so its covariate columns stay hidden as before. -
as.data.frame()on an event table still hides covariate columns that simply rode along with an imported data frame (et(data)), while showing columns assigned explicitly on the event table (ev$wt <- 70, #1154). The covariate is still used when solving. Showing every non-canonical column broke code that imports events and then joins its own covariates back ontoas.data.frame(ev), since the join producedwt.x/wt.yand the model parameter disappeared.
- The
parsed_md5of a model no longer depends on how many models were built before it in the session.linCmtSenswas folded into the hash but only assigned after the model was parsed, so the first build of a session hashed with an unset value and every later build hashed with the previous call's value. Because the compiled DLL is named fromparsed_md5, the same model could get two different cache keys (and hence a redundant recompile) depending on build order. It is now set before the parse.
-
RcppParallelis now a runtime import (added toImportswith animportFrom), so its shared library is loaded into the process beforerxode2's.rxode2links againstRcppParallel(-lRcppParallel); withRcppParallelonly inLinkingToits DLL was not guaranteed to be loaded first, so on Windowslibrary(rxode2)could fail withLoadLibrary failure: The specified module could not be found. This surfaced with RcppParallel 6.0.0, which statically links TBB and no longer ships thetbb.dllstub that previously happened to pull the library in. -
On Windows with RcppParallel >= 6.0.0 (which statically links TBB through Rtools and no longer loads
tbb.dll), the stale-ltbb/-ltbbmallocflags and the-Lpath to RcppParallel's old dynamic TBB directory thatStanHeaders::LdFlags()still emits are stripped at configure time, so the rxode2 DLL no longer records an unresolvable runtime dependency ontbb.dll. The strip is keyed to that stale-L<RcppParallel/lib>signature, so a future StanHeaders that emits corrected flags -- or a user-supplied TBB viaTBB_LINK_LIB/TBB_LIB-- is left untouched (#1161). -
The vendored SUNDIALS
*NewEmptyconstructors now allocate withcallocinstead ofmalloc, so any struct fields added by a newer SUNDIALS release are NULL (and safely ignored) rather than uninitialized (#1155).
- Model piping no longer shares the
metaenvironment by reference between the original and the piped model..newModelAdjust()assigned the previous model'smetaenv directly (to retain sticky items), so both models shared one env -- including the cached simulation model ($meta$.simModelBase). Whichever model was solved first cached its simulation model for both, so a piped model could silently drop an appended compartment/state (e.g. anonmem2rximport:mod %>% model(d/dt(AUC) <- f, append=TRUE)) or the original model could silently gain the piped model's states/estimates. The meta env is now copied via.copyEnv()(which drops.simModelBase), so each model keeps its own cache.
- Silenced the CRAN
-Wlto-type-mismatchwarnings seen with LTO/gcc builds. TherxSolveWarnPush()forward declaration insrc/init.cwas missing the variadic...of its definition, and the ODEPACK/DLS001/common block was declared with two inconsistent (but memory-equivalent) layouts across the LSODE/LSODA step routines. Both are now declared consistently; the fixes are layout-preserving and the Fortran solvers produce identical results.
-
rxOptExpr()gainschunkLinesandparallel, to optimize a large machine-generated model (a sensitivity- or Jacobian-augmented model) in contiguous cost-balanced chunks rather than in a single pass. -
Delay differential equations:
delay(state, T)evaluates an ODE state att - T(Monolix semantics), withpast(state, T) <- exprdefining the pre-history. Delayed states are interpolated from the solver's dense output; delay models default to the"dop853+ros4"composite and cap the step size to the smallest delay. The dense-output/history machinery is adapted from the 'dde' package (Rich FitzJohn, Wes Hinsley, Imperial College), whose authors are added as contributors. -
Forward sensitivities for delay models, so
delay()models estimate with gradient-based methods such as FOCEi. Parameter-dependent delays are supported at first order (rxDelayD()); second/third order are generated for constant delays (rxDelayD2()/rxDelayD3()) and rejected for parameter-dependent delays (use a numeric or Gauss-Newton Hessian there). -
Many new ODE solver methods: a large suite of explicit Runge-Kutta tableaus (orders 3-14), stiff Rosenbrock and implicit Runge-Kutta methods (
"ros43","ros6","radauiia5","gauss6","sdirk43","backwardEuler", ...), symplectic steppers, SUNDIALS CVODE ("cvode", linear solver selectable viacvodeLinSolver=), and LSODE/BDF. Implicit methods auto-generate an analytic Jacobian. New helpersrxIsStiff(),rxIsNonStiff(),rxIsImplicit(),rxIsDense(), andrxIsAutoSwitch()classify methods; see the new "ODE solvers" article. -
AutoSwitch composite methods written
"primary+secondary"(e.g."dop853+ros4"): a non-stiff primary with reactive fallback to a stiff secondary, in both the standard and dense-output paths. -
Adjoint sensitivity solving:
rxSolveAdjoint()andrxSolveAdjointRk4()return the samerx__sens_<state>_BY_<param>__output as forward sensitivities via a backward sweep. Exact discrete adjoints exist for the one-step methods ("s"suffix, e.g."dop853s"),"liblsodaadj", and"cvodesadj", including event jumps (dose/reset/replace/multiply), modeledalag/rate/dur, and steady state. Stiff adjoint and forward-sensitivity solvers integrate the augmented system with its analytic Jacobian. -
Jump sensitivities for dosing events (based on https://github.com/dkaschek/EventSensitivities), replacing finite differences as the default (
rxode2.eventSensoption:"jump","fd","both"). Hybrid jump sensitivities are used for matrix exponential andlinCmt()models (up to 3rd order for the ODE/matrix exponential cases). -
Automatic conversion of linear ODE models to
linCmt()at solve time (rxSolve(..., useLinCmt=TRUE), the default), passing detected PK parameters explicitly. Handles a central sub-system with an output-only peripheral observable; systemslinCmt()cannot represent stay explicit ODEs, and a conversion that will not compile falls back to the ODE (only rxode2). -
Adaptive dosing helpers (
bolus(),infuse(),replace(), etc.) now work insidelinCmt()and mixedlinCmt()+ODE models, with Jacobian handling of the dosing events;odeToLin()preserves and renames them when converting. -
linCmt()sensitivity (linCmtB) solves now run in parallel across subjects on the default forward-mode AD Jacobian path (linCmtSensType="AD"), which is stack-local with no shared Stan arena. The reverse-mode AD ("ADr") and finite-difference paths remain single threaded. -
Inductive linearization and matrix exponentials rewritten with a more NONMEM-like interface (automatic ODE->syntax translation retained) and symbolic-differentiation gradients.
-
Added a forward automatic-derivative linear compartment model.
-
ar(cor)residual term simulating continuous-time AR(1) residuals for normal, t, and cauchy error models, addable per endpoint alongside any transform;coris in[0, 1)and the lag correlation decays ascor^(time gap)(Karlsson, Beal and Sheiner 1995). Estimation is supported in nlmixr2est (nlm and focei families). -
lag0()/lead0()/diff0(): likelag()/lead()/diff()but return0instead ofNAwhen there is no prior/following record. A calculated variable may now reference itself throughlag()/lag0()/diff()(a first-order recurrence); a non-lag self-reference is still a required input parameter. -
rxOmegaVarCovDeriv(): non-CholeskyOmegapath returningOmega^{-1},log|Omega|, and their first/second derivatives with respect to each free variance-covariance element. -
rxExpandSens3_()generates analytic third-order forward sensitivity equations;.rxSens()gained avars3argument. -
For downstream packages:
rxSetSolveAtolRtol()/rxGetSolveAtolRtol()in the C function-pointer API, andsetRxThreadId()so a package can drive the per-subject solve from its own OpenMP team. -
rxTest()test blocks now muffle stray progress messages (e.g. "calculate sensitivities"); setoptions(rxode2.test.verbose = TRUE)to see them. Messages asserted withexpect_message()are unaffected. -
coef()methods forrxUimodels (and model functions). By defaultcoef()returns the fixed-effect (theta) estimates;coef(model, level = "omega")returns the random-effect variability matrix andcoef(model, level = "all")returns both.nlme::fixef()continues to return the fixed effects.
-
The C accessors exposed through the function-pointer API (
getRxNsub(),getSolvingOptions(),getSolvingOptionsInd(), and the otherrx_solve*accessors) no longer segfault when handed aNULLor uninitialized solve. They fall back to the global solve; a scalar counter/flag accessor (nsub,nall,nobs,npars, ...) simply reports zero before any solve, exactly as before, so downstream code that probes those counts at load time keeps working (for example babelmixr2's PopED integration, which queries them from.onLoad). An accessor that must dereference a per-subject record (getSolvingOptionsInd()) instead raises a normal catchable R error stating that the solving environment is not set up, rather than dereferencing aNULLpointer and crashing the R process. This hardens downstream packages that call an accessor before their solve pointer has been populated (for example a cold firstnls/nlmfit innlmixr2est). -
A Jacobian entry
df(state)/dy(THETA[n])ordf(state)/dy(ETA[n])(a bracketed parameter reference, which the grammar accepts) no longer segfaults. The synthetic_THETA_n_/_ETA_n_symbol was never registered, so its index stayed-2and the model validator readtb.ss.line[-2]out of bounds. This crashednlm/FOCEi fits that re-parse their generatedcalcJacmodel (whose parameters areTHETA[n]) in the residual/table step -- notably for a delay-differential-equation model whose delay parameter appears in a product of delayed states. -
past(state, tau)on a state with nod/dt(state)now reports that cleanly instead of corrupting the heap. The error path appended nothing to the message buffer and then trimmed a trailing',that was never written, moving the write offset before the start of the buffer; the damage surfaced as adouble free or corruptionabort on a later, unrelated parse rather than at the offending model. The message now names the property ('past(G)' present, but d/dt(G) not defined), and a property with no message branch can no longer underflow the buffer. -
rxOptExpr()no longer fails on a model that usespast(state, tau)and is long enough to be optimized in chunks. Apast()line only parses in a chunk that also holds the matchingd/dt(), and sensitivity augmentation appendspast()after everyd/dt()-- so it reliably landed in a chunk of its own. It is now disguised for the duration of the optimization like any other compartment-scoped left-hand side, and restored byte-exactly afterwards. Together with the fix above this unblocks estimating a non-constant-history DDE (e.g. the rheumatoid arthritis model of Koch et al. 2014, J Pharmacokinet Pharmacodyn 41:291-318, Example 6). -
rxAppendModel()now warns (instead of erroring) when the appended models have no variables in common, so the combined model is still returned; usecommon=FALSEto suppress the warning (#520). -
rxFixPop()no longer tries to literally substitute a fixed mixture proportion (mix()). A mixture proportion must stay a named model-block variable, so substituting its value made the re-parse throw frommix()("the probabilities in a mixture must be in the model block ..."); a downstream caller wrappingrxFixPop()intry()leaked that error to the console during otherwise-successful mixture fits. Fixed mixture proportions are now excluded from the substitution. -
Tests that use datasets from the suggested
nlmixr2datapackage (theo_sd,warfarin,nmtest) now guard their use withskip_if_not_installed("nlmixr2data"), so the test suite runs cleanly whennlmixr2datais not installed (#95).
-
Convert raw R comparison/logical operators (
>,==,&, ...), not only theirrxGt()/rxEq()symengine forms; fixes "user function '>' requires 0 arguments" in FOCEi models with inter-occasion variability (nlmixr2/nlmixr2#390). -
Recognize bare relationals on the second conversion pass of a
Subs()over aDerivative(); unblocks FOCEi IOV models that also have a between-subject eta on a parameter without IOV. -
The numeric-constant canonicalization now evaluates operands in
baseenv()only and guards zero-length results, fixing an "argument is of length zero" error and silent substitution of user-workspace variables (#1109). -
A trig function (
sin/cos/tan) whose argument is a compound expression divided by something (for examplesin(2 * 3.14 * (time - mtime1) / period)) no longer drops its whole argument. The division branch fell through without returning when the numerator was not a single token, so the argument becameNULLand the emitted C code wassin()-- which failed to compile with "too few arguments to function 'sin'". Such models (for example an enterohepatic gallbladder model with a sinusoidal release) now build and fit (nlmixr2/nlmixr2est#513).
- Summing two or more population parameters in an expression that has no
random effect (for example a combined residual error
W <- sqrt(sigma.1. + sigma.2.)) is no longer misreported as "2+ single population parameters in a single mu-referenced expression". That check now fires only for a genuine mu-referenced expression (one that also contains an eta), and the message names the parameters that were actually summed instead of the first parameters in the model (#471).
-
calcJac=TRUErewriting (also used by the stiffros4/dop853+ros4path) no longer breaks delay models declaring literalTHETA_n_/ETA_n_parameters: constant~intermediates stay bound, the literal names are restored, andpast()history lines are re-emitted. -
A state read by
delay()is always kept as a real ODE, so delayed states named like sensitivities (rx__sens_*) keep their definingd/dt()and can use the stiff/dense composite directly. -
Delay models whose analytic Jacobian cannot be generated now fall back to
dop853(dense) instead ofliblsoda, which recorded no delay history and silently returned pre-history values. -
An lhs reading
delay()is now reported correctly in the output data frame (#1140). The dense delay history was freed at the end of each subject's solve, so the post-solve lhs recalculation returned the constant pre-history (0) at every record even though the delayed value drove the ODE. The history is now kept untilrxSolveFree()releases the subject, which also plugs a leak on the discrete-adjoint (rk4s) path where it was never freed.
-
Fixed a compartment-indexing bug where a model with both an error model and an in-equation compartment reference (e.g.
Cp <- peripheral1 / vp) read an unwritten slot. -
tad(<state>)/tlast(<state>)no longer returnNAor the wrong value when the model also declares an extracmt()for an algebraic observable (nlmixr2est#685). -
The automatic
linCmt()conversion no longer fires on a nonlinear model whose nonlinearity is written through a state-derived observable (e.g. Michaelis-Menten viaCc <- central / vc). -
The automatic
linCmt()conversion no longer changes results when the event data addresses a compartment (in a dose or an observation record) by the name of an ODE compartment the conversion renames (e.g. an ODEcentrecompartment addressed asCMT = "centre", which the conversion renames tocentral). Such a solve now falls back to the original ODE model instead of routing the record nowhere and returning all-zero predictions. -
Fixed the automatic
linCmt()conversion cache reusing the first model's initial estimates for a later model that shares the samemodel({})equations but has a differentini({})block, which made structurally identical models with different parameters return identical predictions. -
Fixed the string form of the compartment argument in the adaptive dosing helpers (e.g.
bolus(50, cmt = "depot")).
-
Zero the LSODA solver work memory on allocation (
alloc_mem,callocinstead ofmalloc). The shared work block (Nordsieck historyyh, Jacobian workspacewm,acor/savf, ...) was left uninitialised and parts are read before the integrator writes them on some paths (e.g. a first stiff/BDF step at an extreme point), making a solve non-deterministic. Surfaced by valgrind as reads of uninitialised LSODA memory inside FOCEi/impmap inner solves, and downstream as an occasional blown-up importance-sampling fit run after a prior (parallel) fit. Solving is otherwise unchanged. -
lag()/diff()(andfirst()/last()) previously returned a constant instead of the prior record's value for calculated variables and time-varying covariates; they now read the prior record (NAon each individual's first record) and work through the estimation/symengine path. Onlylag(x, 1)/diff(x, 1)are supported for calculated variables. -
Bug fix for
mix()models andiCovmodels. -
The
rxMemoryEstimate()RAM detection no longer calls the defunctutils::memory.limit()(which warned on every Windows solve); total RAM is now queried natively in C (GlobalMemoryStatusExon Windows,sysctlon macOS,sysconfon Linux) and available memory reuses the allocator preflight estimate (rxAvailableMemoryBytes()). This also drops thememusesuggested dependency and the shell-command fallbacks. -
Fixed out-of-bounds heap reads (AddressSanitizer-confirmed; results unchanged):
rxSolve()parameter setup when subjects share one event table in annsim > 1sorted solve;syncIdx()dose-index lookup;cvPost()with a 1x1omega;linCmt.hlinCmtStan2ssInf8;etTran()combineDvid;rxDerived()derived1.
-
geom_cens()/stat_cens()no longer emit "Ignoring unknown aesthetics" warnings when censoring aesthetics are mapped. Documentation corrected to describe the two supported lowercase forms:lower/upper(both required) orcens(with optionallimit). The two forms cannot be mixed,lowerandupperare now required together, andlimitwithoutcensis rejected rather than silently ignored. -
Checks for
is.loaded()before loading a rxode2 model. This helps fix the m1 ODR issue shown in nlmixr2est. -
Moved
dim.rxEt()here instead of in nlmixr2est
-
Various low level fixes to allow
nlmixr2estto have parallelized focei. -
Parallelized the
rxode2data.frame creation. -
Added parallel solving
miraifor clusters and HPC support. -
Added out of memory solve using
arrow/duckdb. These out-of-memory (rxSolveOom) solves behave like a standard solved object: it prints the$paramsand$inits(mirroring therxSolveconsole output), supports$,head(),nrow(),ncol()/dim()and the usualas.data.frame()/as_tibble()/as.data.table()coercions, and exposes the per-subject parameter table and initial conditions that are now persisted alongside the chunked data. A DuckDB query layer over the parquet chunks is used for lazy access (head(), single-column extraction, schema) when available. The chunks can also be queried lazily withdplyr(viaas.arrow()orarrow::to_duckdb()) so that filtering and aggregation are pushed down to the on-disk chunks and a possibly out-of-memory result never has to be fully materialized. The storage/query engine can be pinned with therxode2.oom.backendoption ("auto","duckdb","arrow"or"rds"); the option is also forwarded to parallel (mirai) workers. -
Use ALTREP for
id,sim.id, repeated simulation event columns (evid,cmt,ss,amt,rate,dur,ii,time), covariates and kept variables when blocks are identical across simulations; falls back to filled out columns when runtime event mutation is detected (evid_()push growth / per-individual event reallocation). Also factors cannot currently be represented by altrep, so they are forced to be fully represented. -
Change compile flags and compiler directives for rxode2 models to speed up how they run.
-
Have a pre-allocated context pool for lsoda in both liblsoda and lsoda (faster because memory doesn't need to allocated and deallocated so often)
-
Change OMP scheduling to dynamic to try to help load-balance the ode solving per subject.
-
Simulation normal random numbers before integrating them into your solve.
-
Add
evid_()function to allow arbitrary doses and observations in a rxode2 model. -
Add
splitBolus()function to split or relocate doses in the final output. This is done at translation time (but is respected byevid_()) so in general is a bit faster then arbitrary doses in an estimation step fornlmixr2 -
Add
%%operator to valid rxode2 syntax -
Create per-individual ODE solving tolerances for use in focei.
-
Fix potential security and memory-management issues that could lead to crashes or undefined behavior including integer overflow
-
Change
dop853to allow per state tolerances and parallel solving likeliblsoda. -
Change
dop853to be able to usedense=TRUEfor the 8th order dense polynomial interpolation between dosing events. -
Now
dop853can be parallelized per thread. -
Change mtime state-based dosing to use less memory.
-
Add
plogis()translation insiderxode2to it's c-basedexpit()functions -
Refactored
et()to be mostly in R, fixing many issues (#722 , #725, #858, #732, #723, #721, and #724) and allowing dosing/sampling windows to useii,addlanduntil(realized immediately) -
Add
linToOde()convertlinCmt()models to ODEs. -
Fix IOV simulation issue observed in #982.
-
Fix sticky variable calculation (#1013, #1025)
-
More easily identify initial conditions (#948)
-
Fix sensitivities in the
linCmt()that did not match the ODE (#1018, #1012) -
Added in-solve addition of observations (
obs()), bolus dosesbolus(), infusion dosesinfuse()orinfuseDur(), system resetsreset(), compartment replacementreplace(), multiplicaton eventsmultiply(), and phantom/transit compartment eventsphantom(). For more granular control you can also useevid_(). -
Refactor string comparison in
rxode2so that it is actually doing an integer comparison when running the ODE solving routine (simulation and estimation) instead of using a string comparison. It makes using strings like (sex == "male") run faster. -
Add
rxMemoryEstimate()andrxMemSummary()to estimate the amount of memory that is required for a rxode2 solve. -
Add
tolFactor, a per individual change of the tolerances to be used in solving. This is used have individualized tolerances fromnlmixr2est. -
Add
serializeFileas an option to save the rxode2 C fitting data and then restore as needed. -
Add out of memory solve capabilities
-
Allow state-dependent
dur(),rate(),alag(),mtime()now allow states to modify their behavior. The state value at the time of the event is used to calculate any changes. -
Fix: all six ODE solve loops now use precomputed
timeThreadvalues for event times instead of recomputing viagetTime_()withypNA, preventing NA propagation for any state-dependent lag scenario. -
Export the internal
.rxGetSeed()and.rxSetSeed()for use in thenlmixr2savepackage. -
Bug fix for
.copyUi()with the new format (5.0+) of rxode2 ui models -
With new versions of R,
getOption()is no longer a bottleneck, so syncing to local variables is no longer done internally -
Allow transforms to return
NA. -
Drop
magrittrand use|>instead of%>%in the examples (requires R 4.1) -
Change default model serialization to
bzip2and move binary code generation inside of C. -
Fix where getting seed saves/modifies the RNG scope, as well as a bug fix for restoring the random seed state
-
Change random number generation to always return doubles internally as well as no longer take a rxode2 individual structure, this is inferred by the thread number.
-
Change string representation of model variables to internal binary C code (to avoid macOS M1 sanitizer issues with strings).
-
Allow user to change the internal serialization type with
options("rxode2.serialize.type"); Currently can be one of "qs2", "qdata", "base", "bzip2" and "xz". This option must be set beforerxode2is loaded, once loaded it keeps the option initially set. This is set toxzwhich is from base R, but could be sped up with either"qs2"(more future proof) or"qdata"(a bit faster). -
Removed lsoda
CDIR$ IVDEPdirective, as requested by CRAN.
-
Better error for
tad(depot)whenlinCmt()doesn't include a depot compartment. -
Remove
qsdependency; For rxode2 ui objects, use lists instead of serialized objects. The internal C++ code still generatesqs2sterilization objects (#950) -
Fixed translation for censoring/limit to account for a possible
CMTvariable before theCENS/LIMITcolumn (#951, #952) -
Added
dmexpit()for getting the diagonal Jacobian. -
Added special handling of
mixestandmixunif.
-
Stacking for multiple-endpoint
ipredSimnow matches multiple-endpointsim; Issue #929 -
Fix occasional
$propsthat threw an error with empty properties (when using properties liketad0()); Issue #924 -
Allow mixture models
mix()to be loaded withrxS()as a step to support mixtures in nlmixr2's focei; Issue #933. -
Identify the correct transformation type for
iovvariables (#936) -
Fix multiple compartment simulation edge cases where simulations were not being performed (#939)
-
When referencing
cmtin models, the variable is forced to beCMT(related to #939) -
Added ability to use
mixestormixunifto preserve the selected mixture estimates when performing a table step for a nlmixr2 mixture model (#942)
-
Change rxui
$evaluation when completing in rstudio, fixes strange calculations popping up inrstudio(#909) -
Add orphan
rxode2model unloading when usingrxUnloadAll(), and change the return type to always be a boolean. -
Add
assertRxUiIovNoCorto assert IOVs have no correlations in them. -
Handle the levels for inter-occasion variability in the ui better (#614)
-
Create a new function
mix()that will allow mixture models to be simulated in preparation of mixture support innlmixr2. This allows mixture models to be specified as:v = mix(v1, p1, v2, p2, v3)where the probability of havingv=v1is modeled byp1,v=v2is modeled byp2, andv=v3is modeled by probability1-p1-p2. -
Created new functions
mlogit()andmexpit()to convert probabilities used in mixture models to log-scaled values.mlogit()converts the probabilities to log-scaled values (using root-finding) andmexpit()converts the log values into probabilities. The equation for the conversion of log to probabilities is$p_i = \frac{exp(x_i)}{1+\sum_{j=1}^{N-1}exp(x_j)}$ -
Added new assertion
assertRxUiNoMixwhich throws an error when a mixture model is present (iemix()) -
Fix for label processing when calling
rxode2(uiModel)
- For CRAN's m1 ASAN checks of nlmixr2est, loading and unloading the
same dll or by deleting the dll and recreating the exact same code,
and then loading the dll will cause the ASAN check to flag an odr
violation. Because of this, a mechanism to not unload dlls has been
added. This allows the next version of
nlmixr2estto not have issues with Mac m1 san checks.
-
At the request of CRAN, be a bit more careful so that names are not duplicated. Now include the md5 hash, a global counter and random 4 digit and number combination. In addition add the name of the original function so it will be easier to debug in the future.
-
Fall back to data.frame
rbindwhenrbind.rxSolve()fails
-
Add the ability to use
rbindfor solvedrxode2frames. -
Fix
LTOissue for_rxode2_calcDerived
-
Add more information errors about
NAs during solving. -
Fix
rxDerived()for mixed vector and non-vector input. -
Fix model variables for
alag(cmt)when they are defined befored/dt()orlinCmt() -
Just in time use of
state.ignorein the model variables, fixes negative length error observed in #857. -
Fix steady state bug with time-varying covariates. Now the covariates are inferred at the time of the steady state (instead of searching through the subject based on the projected time).
-
Rework the linear solved systems to use the wnl solutions, and threaded linear systems solve (for non-gradient solutions). This new method closes a variety of linear compartment model bugs (#261, #272, #441, #504, #564, #717, #728, #827, and #855)
-
Added new types of bounds for event tables:
-
3 point bounds
et(list(c(low, mid, high)))when specified this way, they will not change. Perfect for use withbabelmixr2'sPopED(#862, #863, #854) -
Intervals simulated by normal values instead of uniform. In this case the first seen interval will be 3 elements with NA at the end
et(list(c(mean, sd, NA), c(mean, sd))), and the other elements can simply be 2 declaring thec(mean, sd) -
Of course the uniform windows of
et(list(c(low, high)))still work -
Currently these different types of windows cannot be mixed.
-
-
Add ability to pipe a list or named numeric as an eta with
%>% ini(~eta) -
Added a fix for event tables where expanding IDs in non-sequential order. In particular if the first ID is not the minimum ID when expanding the first event table, the smallest ID was not in the output table. Now the smallest ID is in the event table. (Fixes #878, #869, #870)
-
Added ability to pipe
ini()orlotri(), or any other expression that can be converted to an ini withas.ini(). Also allowsini()expressions to be converted to lotri withas.lotri(). Fixes #871 -
Added new type of variability expression for simulation and estimation with focei and likelihood related methods:
+var(). This changes standard deviation parameters to variance parameters. -
Added new type of endpoint expression for focei estimation
+dv(). This only transforms the data and not the predictions. I can only see it being useful in model linearization. -
Bug fix for parameters that are in both input (
$params) and output ($lhs) that respects the order of the$lhsdeclaration (Fixes #876) -
Add
rxFixResto literally fix the residual estimates in a model (#889) -
Now modeled duration of 0 is treated as a bolus dose (#892)
-
Add stable hashes for rxUi objects (#838, #689)
-
Fix for iov simulation (#842)
-
Fix for
rxnbinom()called directly from R (#847) and expand it to match more close with R'srnbinom()including allowing namedmu=calls. In rxode2 ui, these are also now allowed.
-
Add
logit/expitnamed expressions, that islogit(x, high=20)becomeslogit(x, 0, 20)in ui models. -
Updated random ui models like
rxnorm(sd=10)to accept complex numeric expressions likerxnorm(sd=10+1). -
Updated random ui models to accept complex non-numeric expressions like
rxnorm(sd=a+b) -
Rework the
tad()and related functions so they use the same interface as compartments (this way they do not depend on the order of compartments); See #815. For mu-referencing, Also allow dummy variables to ignore state requirements (iepodo(depot)in a single line will not error when parsing mu-referenced equations). -
Add
getRxNparsto api. This allows the development version ofbabelmixr2to better check what model is loaded and unload/reload as necessary. -
Add
rxUdfUiControl()to rxode2 user function to get control information from something likenlmixr2 -
Bug fix for tracking time after dose when dosing to 2 compartments occur at the exact same time (#804, #819)
-
Change
transit()model so that it usestad0(),podo0()and related functions for a bit more stable simulation and estimation -
Fix compile flags to work with BH 1.87 (#826)
-
Bug fix for
api, the censoring function pointer has been updated (#801). -
Query
rxode2.verbose.pipeat run time instead of requiring it to be set before loadingrxode2. -
Have correct values at boundaries for
logit,expit,probit, andprobitInv(instead ofNA). For most cases this does not break anything. -
Add a new style of user function that modifies the
uiwhile parsing or just before using the function (in the presence ofdata). -
Used the new user function interface to allow all random functions in
rxode2ui functions to be named. For example, you can userxnorm(sd=3)instead of having to userxnorm(0, 3), althoughrxnorm()still works.
- Explicitly initialize the order vector to stop valgrind warning (requested from CRAN)
-
The model properties was moved from
$paramsto$propsso it does not conflict with the low levelrxode2model$params -
Error when specifying
wdwithoutmodName -
With Linear and midpoint of a time between two points, how
rxode2handles missing values has changed. When the missing value is lower than the requested time, it will look backward until it finds the first non-missing value (or if all are missing start looking forward). When the missing value is higher than the requested time, the algorithm will look forward until it finds the first non-missing value (or if all are missing, start looking backward). -
The order of ODEs is now only determined by the order of
cmt()andd/dt(). Compartment properties,tad()and other compartment related variables no no longer affect compartment sorting. The optionrxode2.syntax.require.ode.firstno longer does anything. -
The handling of zeros "safely" has changed (see #775)
-
when
safeZero=TRUEand the denominator of a division expression is zero, use the Machine's small number/eps(you can see this value with.Machine$double.eps) -
when
saveLog=TRUEand the x in thelog(x)is less than or equal to zero, change this tolog(eps) -
when
safePow=TRUEand the expressionx^yhas a zero forxand a negative number foryreplacexwitheps.
Since the protection for divide by zero has changed, the results will also change. This is a more conservative protection mechanism than was applied previously.
-
-
Random numbers from
rxode2are different when usingdop853,lsodaorindLinmethods. These now seed the random numbers in the same way asliblsoda, so the random number provided will be the same with different solving methods. -
The arguments saved in the
rxSolvefor items likethetaMatwill be the reduced matrices used in solving, not the full matrices (this will likely not break very many items)
iCovis no longer merged to the event dataset. This makes solving withiCovslightly faster (#743)
-
You can remove covariances for every omega by piping with
%>% ini(diag())you can be a bit more granular by removing all covariances that have eithereta.kaoreta.clby:%>% ini(diag(eta.ka, eta.cl))or anything with correlations witheta.clwith%>% ini(diag(eta.cl)) -
You can also remove individual covariances by
%>% ini(-cov(a, b))or%>% ini(-cor(a,b)). -
You can specify the type of interpolation applied for added dosing records (or other added records) for columns that are kept with the
keep=option inrxSolve(). This new option iskeepInterpolationand can belocffor last observation carried forward,nocbwhich is the next observation carried backward, as well asNAwhich puts aNAin all imputed data rows. See #756.-
Note: when interpolation is linear/midpoint for factors/characters it changes to locf with a warning (#759)
-
Also note, that the default keep interpolation is
na
-
-
Now you can specify the interpolation method per covariate in the model:
-
linear(var1, var2)says bothvar1andvar2would use linear interpolation when they are a time-varying covariate. You could also uselinear(var1) -
locf()declares variables using last observation carried forward -
nocb()declares variables using next observation carried backward -
midpoint()declares variables using midpoint interpolation
-
-
linear(),locf(),locb(),midpoint(),params(),cmt()anddvid()declarations are now ignored when loading arxode2model withrxS() -
Strings can be assigned to variables in
rxode2. -
Strings can now be enclosed with a single quote as well as a double quote. This limitation was only in the rxode2 using string since the R-parser changes single quotes to double quotes. (This has no impact with
rxode2({})and ui/function form). -
More robust string encoding for symengine (adapted from
utils::URLencode()andutils::URLdecode()) -
Empty arguments to
rxRename()give a warning (#688) -
Promoting from covariates to parameters with model piping (via
ini()) now allows setting bounds (#692) -
Added
assertCompartmentName(),assertCompartmentExists(),assertCompartmentNew(),testCompartmentExists(),assertVariableExists()testVariableExists(),assertVariableNew(),assertVariableName(), andassertParameterValue()to verify that a value is a valid nlmixr2 compartment name, nlmixr2 compartment/variable exists in the model, variable name, or parameter value (#726; #733) -
Added
assertRxUnbounded(),testRxUnbounded(),warnRxBounded()to allownlmixr2warn about methods that ignore boundaries #760 -
Added functions
tad0(),tafd0(),tlast0()andtfirst0()that will give0instead ofNAwhen the dose has not been administered yet. This is useful for use in ODEs sinceNAs will break the solving (so can be used a bit more robustly with models like Weibull absorption). -
rxode2is has no more binary link tolotri, which means that changes in thelotripackage will not requirerxode2to be recompiled (in most cases) and will not crash the system. -
rxode2also has no more binary linkage toPreciseSums -
The binary linkage for
dparseris reduced to C structures only, making changes in dparser less likely to cause segmentation faults inrxode2if it wasn't recompiled. -
A new model property has been added to
$props$cmtPropand$statePropDf. Both are data-frames showing which compartment has properties (currentlyini,f,alag,rateanddur) in therxode2ui model. This comes from the lower level model variable$statePropwhich has this information encoded in integers for each state. -
A new generic method
rxUiDeparsecan be used to deparse meta information into more readable expressions; This currently by default supports lower triangular matrices by lotri, but can be extended to support other types of objects like 'nlmixr2'sfoceiControl()for instance.
-
Fix
ui$props$endpointwhen the ui endpoint is defined in terms of the ode instead of lhs. See #754 -
Fix
ui$propswhen the ui is a linear compartment model withoutkadefined. -
Model extraction
modelExtract()will now extract model properties. Note that the model property ofalag(cmt)andlag(cmt)will give the same value. See #745 -
When assigning reserved variables, the parser will error. See #744
-
Linear interpolation will now adjust the times as well as the values when
NAvalues are observed. -
Fix when keeping data has
NAvalues that it will not crash R; Also fixed some incorrectNAinterpolations. See #756 -
When using
cmt()sometimes the next statement would be corrupted in the normalized syntax (like for instancelocf); This bug was fixed (#763) -
keepwill now error when trying to keep items that are in the rxode2 output data-frame and will be calculated (#764)
- At the request of CRAN, combine
rxode2parse,rxode2random, andrxode2etinto this package; The changes in each of the packages are now placed here:
- Fix import of data where there are NA times
- Fix formatting issues identified by m1mac, as requested by CRAN
-
Make the stacking more flexible to help rxode2 have more types of plots
-
Add
toTrialDurationby Omar Elashkar to convert event data to trial duration data -
Fix Issue #23 and prefer variable values over NSE values
-
Fix dollar sign accessing of objects (like data frames), as pointed out by @frbrz (issue #16)
-
Use
rxode2parsefunctions for internal event table creation (where they were moved to). -
Dropped C++14 and let the system decide.
-
Split off
et(),eventTable()and related functions. -
Also split off
rxStack()andrxCbindStudyIndividual()in this package. -
Added a
NEWS.mdfile to track changes to the package.
- Fix a bug when simulating nested variables (#25)
- Breaking Change changed distributions from the standard C++
<random>toboost::random. Since this is not dependent on the compiler, it makes the random numbers generated from Mac, Windows and Linux the same for every distribution. Unfortunately with a new random number transformation, the simulation results will likely be different than they were before. The exception to this is the uniform number, which was always the same between platforms.
- Fixed formatting issues (as requested by CRAN and identified on
m1mac)
-
Added function
dfWishartwhich gives (by simulation) an approximation of the degrees of freedom of a Wishart to match arsevalue. -
Added function
swapMatListWithCubewhich swaps omegaList with omegaCube values -
Ensure that the outputs are integers (instead of long integers) as requested by CRAN for some checking functions.
- Fix qassert LTO
- Moved fast factor to
rxode2parseto allowetTransto be moved there
-
Initial release of
rxode2random, which separates the parallel safe, random number generation from 'rxode2' into a separate package to reduce 'rxode2' compilation time. This should make CRAN maintenance a bit easier. -
Added a
NEWS.mdfile to track changes to the package.
- As requested by CRAN remove the C code
SET_TYPEOFwhich is no longer part of the C R API.
-
Added a evid suffix of 60 for cases where evid=2 adds an on event (fixes tad() calculation in certain edge cases)
-
Initialize all variables to
NA
-
Removed linear compartment solutions with gradients from rxode2parse (and rxode2) when compiled with intel c++ compiler (since it crashes while compiling).
-
Fixed
m1macstring issues as requested by CRAN
-
Added ability to query R user functions in a rxode2 model (will force single threaded solve)
-
Moved core
rxFunParseandrxRmFunParsehere so that C and R user function clashes can be handled -
Model variables now tracks which compartments have a lag-time defined
-
For compartment with steady state doses (NONMEM equivalent SS=1, SS=2), an additional tracking time-point is added at to track the time when the lagged dose is given. As an upshot, the lagged dose will start at the steady state concentration shifted by + ii - lag in
rxode2(currently for ode systems only) -
This release calculates non bio-availability adjusted duration for all rates instead of trying to figure the rate duration during solving.
-
Make double assignment an error, ie
a <- b <- -
NAtimes are ignored (with warning) -
Steady state bolus doses with
addlare treated as non steady state events (like what is observed inNONMEM) -
Timsort was upgraded; drop radix support in rxode2 structure
-
etTransnow supports keeping logical vectors (with the appropriate version ofrxode2). -
Security fixes were applied as requested by CRAN
- Import
data.tableexplicitly in the R code (before was imported only in C/C++ code)
- Updates the make flags to support CXX17.
-
'linCmt()' translations of 'alpha', 'beta', 'gamma', 'k21', 'k31', 'vc' now error instead of ignoring 'gamma' and 'k31' to give 2 cmt solution
-
transit compartment internal code now changes dose to 0.0 when no dose has been administered to the depot compartment. This way dosing to the central compartment (without dosing to the transit compartment) will not give a
NAfor the depot compartment (and consequently for the central compartment) -
Moved
rxDerivedhere and added tests for it here as well. -
Moved
etTransParsehere and added tests for it here as well (makes up most ofetTrans). In addition the following changes were made toetTransParse()/etTrans():-
The internal translation (
etTrans()) will not drop times when infusions stop. Before, if the infusion stopped after the last observation the time when the infusion stopped would be dropped. This interferes withlinCmt()models. -
Breaking change/bug fix
evid=2are considered observations when translating data to internalrxode2event structure -
Fix edge case to find infusion duration when it is the first item of the dosing record at time 0.
-
-
Fixed a bug for certain infusions where the
rate,iiand/orssdata items were dropped from the output whenaddDosing=TRUE -
Also have internal functions to convert between classic NONMEM events and rxode2 events
-
Have an internal function that gives information on the linear compartmental model translation type, which could be useful for babelmixr2
-
'time' in model is now case insensitive
-
Use function declaration in
rxode2parseGetTranslation()to determine thread safety of functions available to rxode2 -
Add check for correct number of function arguments to parser.
-
Like R, known functions can be assigned as a variable and the function can still be called (while not changing the variable value). For example you can have a variable
gammaas well as a functiongamma(). -
Fix garbled error messages that occur with certain messages.
-
Fixed errors that occurred when using capitalized AMT variables in the model.
- Version bump for dparser (so binaries will be built correctly)
-
Bug fix for strict prototypes
-
Removed
sprintfas noted by CRAN -
Made
rxode2parsedll binary independent ofrxode2()
- Bug fix for strict aliasing as requested by CRAN
- Use strict aliasing as requested by CRAN
- Initial release to split of rxode2parse from rxode2 to reduce compilation time of 'rxode2'
-
Make sure that the object is a uncompressed rxode2 ui for solving with
rxSolve(See #661) -
Fix #670 by using the last simulated observation residual when there are trailing doses.
-
Create a function to see if a rxode2 solve is loaded in memory (
rxode2::rxSolveSetup()) -
Create a new function that fixes the rxode2 population values in the model (and drops them in the initial estimates);
rxFixPop()
-
Pendantic no-remap (as requested by CRAN)
-
gcc USBAN fix (as requested by CRAN)
-
rxUicompression now defaults to fast compression -
Fixes String literal formatting issues as identified by CRAN (#643)
-
Removes linear compartment solutions with gradients for intel c++ compiler (since they crash the compiler).
-
Steady state with lag times are no longer shifted by the lag time and then solved to steady state by default. In addition the steady state at the original time of dosing is also back-calculated. If you want the old behavior you can bring back the option with
ssAtDoseTime=FALSE. -
"dop853" now uses the
hmax/h0values from therxControl()orrxSolve(). This may change some ODE solving using "dop853" -
When not specified (and xgxr is available), the x axis is no longer assumed to be in hours
-
User defined functions can now be R functions. For many of these R functions they can be converted to C with
rxFun()(you can see the C code afterwards withrxC("funName")) -
Parallel solving of models that require sorting (like modeled lag times, modeled duration etc) now solve in parallel instead of downgrading to single threaded solving
-
Steady state infusions with a duration of infusions greater than the inter-dose interval are now supported.
-
Added
$symengineModelNoPruneand$symengineModelPrunefor loading models into rxode2 withrxS() -
When plotting and creating confidence intervals for multiple endpoint models simulated from a rxode2 ui model, you can plot/summarize each endpoint with
sim. (ie.confint(model, "sim")orplot(model, sim)).If you only want to summarize a subset of endpoints, you can focus on the endpoint by pre-pending the endpoint with
sim.For example if you wanted to plot/summarize only the endpointeffyou would usesim.eff. (ieconfint(model, "sim.eff")orplot(model, sim.eff)) -
Added
model$simulationIniModelwhich prepend the initial conditions in theini({})block to the classicrxode2({})model. -
Now
model$simulationModelandmodel$simulationIniModelwill save and use the initialization values from the compiled model, and will solve as if it was the original ui model. -
Allow
ini(model) <- NULLto drop ini block andas.ini(NULL)givesini({})(Issue #523) -
Add a function
modelExtract()to extract model lines to allow modifying them and then changing the model by piping or simply assigning the modified lines withmodel(ui) <- newModifiedLines -
Add Algebraic mu-referencing detection (mu2) that allows you to express mu-referenced covariates as:
cl <- exp(tcl + eta.cl + wt_cl * log(WT/70.5))Instead of the
cl <- exp(tcl + eta.cl + wt_cl * log.WT.div.70.5)That was previously required (where log.WT.div.70.5 was calculated
in the data) for mu expressions. The ui now has more information to
allow transformation of data internally and transformation to the old
mu-referencing style to run the optimization.
-
Allow steady state infusions with a duration of infusion greater than the inter-dose interval to be solved.
-
Solves will now possibly print more information when issuing a "could not solve the system" error
-
The function
rxSetPipingAuto()is now exported to change the way you affect piping in your individual setup -
Allow covariates to be specified in the model piping, that is
mod %>% model(a=var+3, cov="var")will add"var"as a covariate. -
When calculating confidence intervals for
rxode2simulated objects you can now usebyto stratify the simulation summary. For example you can now stratify by gender and race by:confint(sim, "sim", by=c("race", "gender")) -
When calculating the intervals for
rxode2simulated objects you can now useci=FALSEso that it only calculates the default intervals without bands on each of the percentiles; You can also choose not to match the secondary bands limits withlevelsbut use your ownci=0.99for instance -
A new function was introduced
meanProbs()which calculates the mean and expected confidence bands under either the normal or t distribution -
A related new function was introduced that calculates the mean and confidence bands under the Bernoulli/Binomial distribution (
binomProbs()) -
When calculating the intervals for
rxode2simulated objects you can also usemean=TRUEto use the mean for the first level of confidence usingmeanProbs(). For this confidence interval you can override thenused in the confidence interval by usingn=#. You can also change this to a prediction interval instead usingpred=TRUE. -
Also when calculating the intervals for
rxode2simulated object you can also usemean="binom"to use the binomial distributional information (and ci) for the first level of confidence usingbinomProbs(). For this confidence interval you can override thenused in the confidence interval by usingn=#. You can also change this to a prediction interval instead usingpred=TRUE. Withpred=TRUEyou can override the number of predicted samples withm=# -
When plotting the
confintderived intervals from anrxode2simulation, you can now subset based on a simulated value likeplot(ci, Cc)which will only plot the variableCcthat you summarized even if you also summarizedeff(for instance). -
When the rxode2 ui is a compressed ui object, you can modify the ini block with
$ini <-or modify the model block with$model <-. These are equivalent toini(model) <-andmodel(model) <-, respectively. Otherwise, the object is added to the user defined components in the function (ie$meta). When the object is uncompressed, it simply assigns it to the environment instead (just like before). -
When printing meta information that happens to be a
lotricompatible matrix, uselotrito express it instead of the default R expression. -
Allow character vectors to be converted to expressions for piping (#552)
-
rxAppendModel()will now take an arbitrary number of models and append them together; It also has better handling of models with duplicate parameters and models withoutini()blocks (#617 / #573 / #575). -
keepwill now also keep attributes of the input data (with special handling forlevels); This means a broader variety of classes will be kept carrying more information with it (for example ordered factors, data frame columns with unit information, etc) -
Piping arguments
appendforini()andmodel()have been aligned to perform similarly. Thereforeini(append=)now can take expressions instead of simply strings andmodel(append=)can also take strings. Also model piping now can specify the integer line number to be modified just like theini()could. Alsomodel(append=FALSE)has been changed tomodel(append=NULL). While the behavior is the same when you don't specify the argument, the behavior has changed to align withini()when piping. Hencemodel(append=TRUE)will append andmodel(append=FALSE)will now pre-pend to the model.model(append=NULL)will modify lines like the behavior ofini(append=NULL). The default ofmodel(line)modifying a line in-place still applies. While this is a breaking change, most code will perform the same. -
Labels can now be dropped by
ini(param=label(NULL)). Also parameters can be dropped with the idiommodel(param=NULL)orini(param=NULL)changes the parameter to a covariate to align with this idiom of dropping parameters -
rxRenamehas been refactored to run faster
-
Add
as.model()for list expressions, which impliesmodel(ui) <- ui$lstExprwill assign model components. It will also more robustly work with character vectors -
Simulated objects from
rxSolvenow can access the model variables with$rxModelVars -
Simulation models from the UI now use
rxerr.endpointinstead oferr.endpointfor thesigmaresidual error. This is to align with the convention that internally generated variables start withrxornlmixr -
Sorting only uses timsort now, and was upgraded to the latest version from Morwenn
-
Simulating/solving from functions/ui now prefers params over
omegaandsigmain the model (#632) -
Piping does not add constants to the initial estimates
-
When constants are specified in the
model({})block (likek <- 1), they will not be to theiniblock -
Bug fix for
geom_amt()when theaestransformation hasx -
Bug fix for some covariate updates that may affect multiple compartment models (like issue #581)
- Modify plot code to work with development
xgxr
-
CRAN requested that FORTRAN
kindbe changed as it was not portable; This was commented code, and simply removed the comment. -
Bug-fix for
geom_amt(); also now useslinewidthand at leastggplot2 3.4.0 -
Some documentation was cleaned up from
rxode22.0.13
-
A bug was fixed so that the
zeroRe()function works with correlated omega values. -
A bug was fixed so that the
rename()function works with initial conditions for compartments (cmt(0))
-
A new function
zeroRe()allows simple setting of omega and/or sigma values to zero for a model (#456) -
Diagonal zeros in the
omegaandsigmamatrices are treated as zeros in the model. The correspondingomegaandsigmamatrices drop columns/rows where the diagonals are zero to create a newomegaandsigmamatrix for simulation. This is the same idiom that NONMEM uses for simulation from these matrices. -
Add the ability to pipe model estimates from another model by
parentModel %>% ini(modelWithNewEsts) -
Add the ability to append model statements with piping using
%>% model(x=3, append=d/dt(depot)), still supports appending withappend=TRUEand pre-pending withappend=NA(the default is to replace lines withappend=FALSE) -
rxSolve's keep argument will now maintain character and factor classes from input data with the same class (#190)
-
Parameter labels may now be modified via
ini(param = label("text"))(#351). -
Parameter order may be modified via the
appendargument toini()when piping a model. For example,ini(param = 1, append = 0)orini(param = label("text"), append = "param2")(#352).
-
If lower/upper bounds are outside the required bounds, the adjustment is displayed.
-
When initial values are piped that break the model's boundary condition reset the boundary to unbounded and message which boundary was reset.
-
Added
as.rxUi()function to convert the following objects torxUiobjects:rxode2,rxModelVars,function. Converting nlmixr2 fits torxUiwill be placed in thes3method in the corresponding package. -
assertRxUi(x)now usesas.rxUi()so that it can be extended outside ofrxode2/nlmixr2. -
rxode2now supportsaddlwithssdoses -
Moved
rxDerivedtorxode2parse(and re-exported it here). -
Added test for transit compartment solving in absence of dosing to the transit compartment (fixed in
rxode2parsebut solving tested here) -
Using
ini()without any arguments on arxode2type function will return theini()block. Also added a methodini(mod) <- iniBlockto modify theiniblock is you wish.iniBlockshould be an expression. -
Using
model()without any arguments on arxode2type function will return themodel()block. Also added a new methodmodel(mod) <- modelBlock -
Added a new method
rxode2(mod) <- modFunctionwhich allows replacing the function with a new function while maintaining the meta information about the ui (like information that comes fromnonmem2rxmodels). ThemodFunctionshould be the body of the new function, the new function, or a newrxode2ui. -
rxode2ui objects now have a$stickyitem inside the internal (compressed) environment. This$stickytells what variables to keep if there is a "significant" change in the ui during piping or other sort of model change. This is respected during model piping, or modifying the model withini(mod)<-,model(mod)<-,rxode2(mod)<-. A significant change is a change in the model block, a change in the number of estimates, or a change to the value of the estimates. Estimate bounds, weather an estimate is fixed or estimate label changes are not considered significant. -
Added
as.ini()method to convert various formats to an ini expression. It is used internally withini(mod)<-. If you want to assign something new that you can convert to an ini expression, add a method foras.ini(). -
Added
as.model()method to convert various formats to a model expression. It is used internally withmodel(mod)<-. If you want to assign something new that you can convert to a model expression, add a method foras.model().
-
Give a more meaningful error for 'rxode2' ui models with only error expressions
-
Break the ABI requirement between
roxde2()andrxode2parse() -
The new
rxode2parsewill fix thesprintfexclusion shown on CRAN.
-
Time invariant covariates can now contain 'NA' values.
-
When a column has 'NA' for the entire id, now 'rxode2' warns about both the id and column instead of just the id.
-
To fix some CRAN issues in 'nlmixr2est', make the version dependency explicit.
-
Remove log likelihoods from 'rxode2' to reduce compilation time and increase maintainability of 'rxode2'. They were transferred to 'rxode2ll' (requested by CRAN).
-
Remove the parsing from 'rxode2' and solved linear compartment code and move to 'rxode2parse' to reduce the compilation time (as requested by CRAN).
-
Remove the random number generation from 'rxode2' and move to 'rxode2random' to reduce the compilation time (as requested by CRAN).
-
Remove the event table translation and generation from 'rxode2' and move to 'rxode2et' to reduce the compilation time (as requested by CRAN).
-
Change the
rxode2ui object so it is a compressed, serialized object by default. This could reduce theC stack sizeproblem that occurs with too many environments in R. -
Warn when ignoring items during simulations
-
Export a method to change 'rxode2' solve methods into internal integers
-
Bug fix for time invariant covariates identified as time variant covariate when the individual's time starts after
0.
-
rxgammanow only allows arateinput. This aligns with the internalrxode2version ofrxgammaand clarifies how this will be used. It is also aligned with thellikGammafunction used for generalized likelihood estimation. -
ui
cauchysimulations now follow the ui fornormalandtdistributions, which means you can combine with transformations. This is because thecauchyis atdistribution with one degree of freedom. -
ui
dnorm()andnorm()are no longer equivalent toadd(). Now it allows you to use the loglikllikNorm()instead of the standardnlmixr2style focei likelihood. This is done by addingdnorm()at the end of the line. It also meansdnorm()now doesn't take any arguments. -
Vandercorput normal removed (non-random number generator)
-
Allow models in the
nlmixr2form without anini({})block -
Allow model piping of an omega matrix by
f %>% ini(omegaMatrix) -
Standard models created with
rxode2()can no be piped into a model function -
Families of log-likelihood were added to
rxode2so that mixed likelihood nonlinear mixed effects models may be specified and run. -
The memory footprint of a
rxode2solving has been reduced -
Piping now allow named strings (issue #249)
-
rxode2's symengine would convertsqrt(2)toM_SQRT_2when it should beM_SQRT2. This has been fixed; it was most noticeable in nlmixr2 log-likelihood estimation methods -
rxode2treatsDVas a non-covariate withetTran(last time it would duplicate if it is in the model). This is most noticeable in the nlmixr2 log-likelihood estimation methods.
-
A new flag (
rxFlag) has been created to tell you where in therxode2solving process you are. This is useful for debugging. If outputting this variable it will always be11or calculating the left handed equations. If you are using in conjunction with theprintf()methods, it is a double variable and should be formatted with"%f". -
An additional option of
fullPrinthas been added torxode2()which allowsrprintf()to be used in almost all ofrxode2()steps (inductive linearization and matrix exponential are the exception here) instead of just the integrationddtstep. It defaults toFALSE.
-
Removed accidental
^Sfrom news as requested by CRAN. -
Bug fix for more complicated mu-referencing.
-
Change rxode2 md5 to only depend on the C/C++/Fortran code and headers not the R files. That way if there is binary compatibility between
nlmixr2estandrxode2, a new version ofnlmixr2estwill not need to be submitted to CRAN.
-
The options for
rxControlandrxSolveare more strict.camelCaseis now always used. Old options likeadd.covandtransit_absare no longer supported, onlyaddCovis supported. -
A new option,
sigdighas been added torxControl(), which controls some of the more common significant figure options likeatol,rtol,ssAtol,ssRtol, with a single option.
-
For simulations,
$simulationSigmanow assumes a diagonal matrix. The sigma values are assumed to be standard normal, and uncorrelated between endpoints. Simulation with uncertainty will still draw from this identity diagonal matrix -
Parallel solving now seeds each simulation per each individual based on the initial seed plus the simulation id. This makes the simulation reproducible regardless of the number of cores running the simulation.
-
Solved objects now access the underlying rxode model with
$rxode2instead of$rxode -
Since this change names,
rxode2,rxodeandRxODEall perform the same function. -
Options were changed from
RxODE.syntaxtorxode2.syntax. -
Assigning states with
rxode2.syntax.assign.state(wasRxODE.syntax.assign.state) is no longer supported. -
Enforcing "pure" assignment syntax with
=syntax is no longer supported sorxode2.syntax.assignis no longer supported (wasRxODE.syntax.assign). -
Since R supports
**as an exponentiation operator, the pure syntax without**can no longer be enabled. Hencerxode2.syntax.star.pow(wasRxODE.syntax.star.pow) no longer has any effect. -
The "pure" syntax that requires a semicolon can no longer be enabled. Therefore
rxode2.syntax.require.semicolon(wasRxODE.syntax.require.semicolon) no longer has any effect. -
The syntax
state(0)can no longer be turned off.rxode2.syntax.allow.ini0(wasRxODE.syntax.allow.ini0) has been removed. -
Variable with dots in variable and state names like
state.nameworks in R. Therefore, "pure" syntax of excluding.values from variables cannot be enforced withrxode2.syntax.allow.dots(wasRxODE.syntax.allow.dots). -
The mnemonic
et(rate=model)andet(dur=model)mnemonics have been removed.rateneeds to be set to-1and-2manually instead. -
The function
rxode2Test()has been removed in favor of using testthat directly. -
Transit compartments need to use a new
evid,evid=7. That being said, thetransitAbsoption is no longer supported. -
IDcolumns in input parameter data frames are not sorted or merged with original dataset any more; The underlying assumption of ID order should now be checked outside ofrxode2(). Note that the event data frame is still sorted.
-
The UI functions of
nlmixrhave been ported to work inrxode2directly. -
rxModelVars({})is now supported. -
You may now combine 2 models in
rxode2withrxAppendModel(). In fact, as long as the first value is a rxode2 evaluated ui model, you can usec/rbindto bind 2 or more models together. -
You may now append model lines with piping using
%>% model(lines, append=TRUE)you can also pre-pend lines by%>% model(lines, append=NA) -
You may now rename model variables, states and defined parameters with
%>% rxRename(new=old)or ifdplyris loaded:%>% rename(new=old) -
You can fix parameters with
%>% ini(tcl=fix)or%>% ini(fix(tcl))as well as unfix parameters with%>% ini(tcl=unfix)or%>% ini(unfix(tcl))
-
Strict R headers are enforced more places
-
Since there are many changes that could be incompatible, this version has been renamed to
rxode2 -
rxode2()printout no longer uses rules and centered headings to make it display better on a larger variety of systems.
tad()and related time features only reset at the start of an infusion (as opposed to starting at the beginning and end of an infusion)
- Change handling of missing covariates while interpolating "nocb" so that the time-varying covariates use "nocb" interpolation (#469)
-
Fix subject initialization of
foceiproblem (#464) -
Fix LHS offset to allow internal threading and more parallel processing in the future.
-
Remove warnings for duration and rate
-
Don't export pillar methods any more (simply register at load if present)
-
As requested by CRAN, change fortran and C binding for BLAS an LINPACK
-
Fix the LTO issue that CRAN identified.
-
Move the omp files so they come first to support clang13, as identified by CRAN.
-
For now, be a little more conservative in
dur()andrate()warnings becauselinCmt()models innlmixrcurrently produce irrelevant warnings.
-
Always calculate "nolhs" for using numeric differences when the inner problem. This allows the inner problem to fallback to a finite difference approximation to the focei objective function.
-
Updated the parser C code grammar using latest dparser CRAN package
-
Added a new cbind function that is used to mix data frame input with simulated individual parameters and residual parameters,
rxCbindStudyIndividual(). -
Now data frame input can be mixed with simulating from omega and sigma matrices (though not yet in nested simulations)
-
Race conditions when simulating random numbers is solved by chunking each simulation into groups that will always be performed per each thread. This way the simulation is now reproducible regardless of load. Because of the chunking, simulations with random numbers generated inside of it are now threaded by default (though a warning is produced about the simulation only be reproducible when run with the same number of threads)
-
Simulations were double checked and made sure to use the engine reserved for each core run in parallel; Some of the random generators were not taking random numbers from the correct engine, which was corrected. Therefore, simulations from this version are expected to be different (in parallel) than previous versions.
-
Added function
rxSetSeed()to set the internal RxODE seed instead of grabbing it from a uniform random number tied to the original R seed. This will avoid the possibility of duplicate seeds and is the best practice. -
Updating parameter pointers is done once per ID and locked based on ID to remove the recursion in #399, but still have the correct behavior see #430
-
Parsing updated to retain "param()" in normalized model, #432.
-
Handle edge case of interpolation at first index correctly, fixes #433
-
Instead of storing each dose information sequentially, store dose information at the same index of the
eviddefining the dose. This memory rewrite is to fix the issue #435. -
Start using strict headers as it is required for the forthcoming release of
Rcpp. Thanks to Dirk Eddelbuettel for some of the fixes and alerting us to this change. -
Check arguments for
add.dosing()more strictly. See Issue #441 -
Issue a warning when either
dur()orrate()is in the model but the modeled rate and duration is not included in the event table. -
When the data requires a modeled rate and modeled duration but it is not in the model, warn about the mismatch in data
-
Added a back-door for debugging. If you specify
options(RxODE.debug=TRUE)then each solve saves the solving information to the file"last-rxode.qs"before actually solving the system. -
Only will try to solve RxODE problems on compatible models; If the model is not supported it will throw an error instead of crashing (See #449)
-
Turn off parallel ODE solving whenever the system needs to sort times based on model dosing. Currently this type of solving is not thread safe.
-
Update timsort headers to latest version.
-
At the request of CRAN, stripping the debugging symbols for the CRAN release is no longer performed. This means a larger binary size for RxODE in this release.
-
At the request of CRAN the
liblsodacode has been changed so that the memory in C defined by_C()is now defined by_rxC(). This will be seen in some of the error messages, which will no longer match the error messages of unmodified liblsoda. -
iCovbehavior has shifted to merge on the input event dataset. See Issue #409; This is more in line with expectations ofiCovbehavior, and reduces the amount of code needed to maintainiCov.The
iCovin the pipeline is no longer supported because it simply is a merge with the event dataset.This can be a breaking change depending on the code you use. Note that clinical trial simulations, resampling is likely better than trying to fill out
iCovfor every individual which was the prior use. -
Bug fix for crashes with string covariates or factor covariates, issue #410. Also factor column names are compared with case insensitivity just like the rest of the column names for event tables or data sets in
RxODE.
- Fix issue #399
-
Change syntax vignette to use markdown option
screenshot.force=FALSE. This should get rid of thewebshoterror -
Change to depend on dparser 1.3.0, which has some memory fixes
-
RxODE imports but does not link to
checkmateany longer. This change should make recompilation of RxODE to work with different releases ofcheckmateunnecessary. -
Default Solaris solver changed back to "lsoda"
-
Fix Bug #393, where in certain circumstances
rxSolve(...,theta=)did not solve for all subjects. -
Will not ignore NEWS and README when building the package so that they will show up on CRAN. You can also access the news by
news(package="RxODE") -
Changed
ODRmodel names from time id to_rxfollowed by themd5hash id and a per-session counter id; For packages the id is_rxpfollowed by themd5hash and a per-session counter id. -
Changed
qsto be more conservative in hash creation. Add a check hash as well as NOT using altrep stringfish representation.
-
Maintenance release -- use
std::floorand cast variables todoublefor internal C functions. This should allow a successful compile on Solaris CRAN. -
Changed
unitsfrom an Imports to a Suggests to allow testing on Solaris rhub -
Changed
ODRmodel names from time id to_rxfollowed by themd5hash id; For packages the id is_rxpfollowed by themd5hash. -
Removed AD linear compartment solutions for Windows R 3.6, though they still work for Windows R 4.0 (You can get them back for Windows R 3.6 if you install
BH1.66.0-1 and then recompile from source).- This will cause
nlmixrto fail with solved systems on Windows 3.6. Currently the Stan Headers do not compile on this system so they are disabled at this time.
- This will cause
-
RxODE imports but does not link to
qsany longer; This change should make recompilation of RxODE to work with different releases ofqsunnecessary. -
RxODE now checks for binary compatibility for
Rcpp,dparser,checkmate, andPreciseSums
-
RxODE can only use supported functions (could be breaking); You may add your own functions with
rxFunand their derivatives withrxD -
RxODE now uses its own internal truncated multivariate normal simulations based on the threefry sitmo library. Therefore random numbers generated within
RxODElike providingrxSolve(...,omega=)will have different results with this new random number generator. This was done to allow internal re-sampling of sigmas/etas with thread-safe random number generators (calling R throughmvnfastor R's simulation engines are not thread safe). -
RxODEnow moved the precise sum/product type options forsum()andprod()torxSolveorrxControl -
cvPostnow will returned a named list of matrices if the input matrix was named -
rxSolvewill now return an integeridinstead of a factoridwhenidis integer or integerish (as defined by checkmate). Otherwise a factor will be returned. -
When mixing ODEs and
linCmt()models, thelinCmt()compartments are 1 and possibly 2 instead of right after the last internal ODE. This is more aligned with how PK/PD models are typically defined. -
EVID=3andEVID=4now (possibly) reset time as well. This occurs when the input dataset is sorted before solving. -
When
EVID=2is present, anevidcolumn is output to distinguishevid=0andevid=2
-
Add the ability to order input parameters with the
param()pseudo-function -
Add the ability to resample covariates with
resample=TRUEorresample=c("SEX", "CRCL"). You can resample all the covariates byIDwithresampleID=TRUEor resample the covariates without respect toIDwithresampleID=FALSE -
Comparison of factors/strings is now supported in
RxODE; Therefore ID=="Study-1" is now allowed. -
Completion for elements of
rxSolve()objects, andet()objects have been added (accessed through$) -
Completion of
rxSolve()arguments are now included since they are part of the main method -
Allow simulation with zero matrices, that provide the simulation without variability. This affects
rxSolveas well asrxMvnrndandcvPost(which will give a zero matrix whenever one is specified) -
et()can dose withlength(amt) > 1as long as the other arguments can create a event table. -
Rstudio notebook output makes more sense
-
Printing upgraded to cli 2.0
-
Caching of internal C data setup is now supported increasing speed of
optimcode when:- Event Table doesn't change
- The size of the parameters doesn't change
initsdo not change (though you can specify them ascmt(0)=...in the model and change them by parameters)- See Issue #109
-
Allow
while(logical)statements with ability to break out if them bybreak. The while has an escape valve controlled bymaxwherewhich by default is 10000 iterations. It can be change withrxSolve(..., maxwhere = NNN) -
Allow accessing different time-varying components of an input dataset for each individual with:
lag(var, #)lead(var, #)first(var)last(var)diff(var)
Each of these are similar to the R lag, lead, first, last and
diff. However when undefined, it returns NA
-
Allow sticky left-handed side of the equation; This means for an observation the left handed values are saved for the next observations and then reassigned to the last calculated value.
This allows NONMEM-style of calculating parameters like tad:
mod1 <-RxODE({
KA=2.94E-01;
CL=1.86E+01;
V2=4.02E+01;
Q=1.05E+01;
V3=2.97E+02;
Kin=1;
Kout=1;
EC50=200;
C2 = centr/V2;
C3 = peri/V3;
d/dt(depot) =-KA*depot;
d/dt(centr) = KA*depot - CL*C2 - Q*C2 + Q*C3;
d/dt(peri) = Q*C2 - Q*C3;
d/dt(eff) = Kin - Kout*(1-C2/(EC50+C2))*eff;
if (!is.na(amt)){
tdose <- time
} else {
tad <- time - tdose
}
})It is still simpler to use:
mod1 <-RxODE({
KA=2.94E-01;
CL=1.86E+01;
V2=4.02E+01;
Q=1.05E+01;
V3=2.97E+02;
Kin=1;
Kout=1;
EC50=200;
C2 = centr/V2;
C3 = peri/V3;
d/dt(depot) =-KA*depot;
d/dt(centr) = KA*depot - CL*C2 - Q*C2 + Q*C3;
d/dt(peri) = Q*C2 - Q*C3;
d/dt(eff) = Kin - Kout*(1-C2/(EC50+C2))*eff;
tad <- time - tlast
})If the lhs parameters haven't been defined yet, they are NA
-
Now the NONMEM-style
newindflag can be used to initializelhsparameters. -
Added
tad(),tad(cmt)functions for time since last dose and time since last dose for a compartment; Also added time after first dose and time after first dose for a compartmenttafd(),tafd(cmt); time of last dosetlast(),tlast(cmt)and dose numberdosenum()(currently not for each compartment) -
Changed linear solved systems to use "advan" style
linCmt()solutions, to allow correct solutions of time-varying covariates values with solved systems; As such, the solutions may be slightly different. Infusions to the depot compartment are now supported. -
Added sensitivity auto-differentiation of
linCmt()solutions. This allows sensitivities oflinCmt()solutions and enablesnlmixrfocei to support solved systems.- One solution is to use Stan's auto-differentiation which requires
C++14
- One solution is to use Stan's auto-differentiation which requires
-
When calculating the empirical Bayesian estimates for with
rxInner(used for nlmixr's 'focei') ignore any variable beginning withrx_andnlmixr_to hide internal variables from table output. This also addedtad=tad()anddosenum=dosenum()to theebeoutput allowing grouping by id, dose number and use TAD for individual plot stratification. -
Added ability to prune branching with
rxPrune. This convertsif/elseorifelseto single line statements without anyif/thenbranching within them. -
Added ability to take more complex conditional expressions, including:
ifelse(expr, yes, no)x = (x==1)*1 + (!(x==1))*2if (logic){ expr} else if (logic) {expr} else {}. The preferred syntax is still onlyif/elseand the corresponding parsed code reflects this preference.- Note
ifelseis not allowed as an ODE compartment or a variable.
- Note
-
Switched to
symengineinstead of usingsympy- Remove dependence on python.
- Since symengine is C-based and doesn't require the python
interface it is much faster than
sympy, though some functions insympyare no longer accessible. - Also symengine requires R 3.6, so now RxODE requires R 3.6
-
Added new ODE solving method "indLin", or inductive linearization. When the full model is a linear ODE system this becomes simply the matrix exponential solution. Currently this requires a different setup.
-
Added arbitrary function definition to RxODE using
rxFun- Requires function, arguments and corresponding C-code
- Derivatives (if required) can be added to the derivative table
rxD. When taking deviates without a derivative function, RxODE will use numerical differences.
-
Will error if RxODE does not know of a function that you are trying to use; This could be a breaking change. Currently:
- C's functions from
math.hare supported - R's function returning and taking doubles are supported
- Other functions can be added using
rxFunandrxD
- C's functions from
-
Added
NA,NaN,Infand+Infhandling to a RxODE model. Can be useful to diagnose problems in models and provide alternate solutions. In addition, added R-like functionsis.nan,is.na,is.finiteandis.infinitewhich can be called within the RxODE block. -
Allowed the following data variables can be accessed (but not assigned or used as a state):
cmtdvidaddlssamtrateidwhich requires calling the id as factorID=="1"for instance.
-
Kept
evidandiias restricted items since they are not part of the covariate table and are restricted in use. -
Added the following random number generators; They are thread safe (based on
threefrysitmoand c++11) and your simulations with them will depend on the number of cores used in your simulation (Be careful about reproducibility with large number of threads; Also use parallel-solve type of RxODE simulations to avoid the birthday problem).During ODE solving, the values of these are
0, but while calculating the final output the variable is randomized at least for every output. These are:rxnorm()andrxnormV()(low discrepancy normal)rxcauchy()rxchisq()rxexp()rxf()rxgamma()rxbeta()rxgeom()rxpois()rxt()rxunif()rxweibull()
In addition, while initializing the system, the following values are simulated and retained for each individual:
rinorm()andrinormV()(low discrepancy normal)ricauchy()richisq()riexp()rif()rigamma()ribeta()rigeom()ripois()rit()riunif()riweibull()
-
Added
simeta()which simulates a newetawhen called based on the possibly truncated normalomegaspecified by the original simulation. This simulation occurs at the same time as the ODE is initialized or when an ODE is missing, before calculating the final output values. Theomegawill reflect whatever study is being simulated. -
Added
simeps()which simulates a newepsfrom the possibly truncated normalsigmaat the same time as calculating the final output values. Before this time, thesigmavariables are zero.
All these change the solving to single thread by default to make sure the simulation is reproducible. With high loads/difficult problems the random number generator may be on a different thread and give a different number than another computer/try.
Also please note that the clang and gcc compiler use different
methods to create the more complex random numbers. Therefore
MacOS random numbers will be different than Linux/Windows at
this time (with the exception of uniform numbers).
These numbers are still non-correlated random numbers (based on the sitmo test) with the exception of the vandercorput distributions, so if you increase the number of threads (cores=...) the results should still be valid, though maybe harder to reproduce. The faster the random number generation, the more likely these results will be reproduced across platforms.
-
Added the ability to integrate standard deviations/errors of omega diagonals and sigma diagonals. This is done by specifying the omega diagonals in the theta matrix and having them represent the variabilities or standard deviations. Then these standard deviations are simulated along with the correlations using the IJK correlation matrix (omega dimension < 10) or a correlation matrix or Inverse Wishart-based correlation matrix (omega dimension > 10). The information about how to simulate this is in the variability simulation vignette.
-
Now have a method to use
lotrito simulate between occasion variability and other levels of nesting. -
Added lower gamma functions See Issue #185
-
Upgraded comparison sort to timsort 2.0.1
-
Changed in-place sort to a modified radix sort from
data.table. The radix search was modified to:
- Work directly with
RxODEinternal solved structures - Assume no infinite values or
NA/NaNvalues of time - Always sort time in ascending order
- Changed sorting to run in a single thread instead of taking over all the threads like data.table
-
Changed method for setting/getting number of threads based on
data.table's method -
Added function
rxDerivedwhich will calculate derived parameters for 1, 2, and 3 compartment models -
More descriptive errors when types of input are different than expected
-
Moved many C functions to C++. CRAN OpenMP support requires C++ only when C and C++ are mixed. See:
-
No longer produces C code that create the model variables. Instead, use
qsto serialize, compress and encode in base91 and then write the string into the C file. Theqspackage then decodes all of that into the model variables. This also increases the compilation speed for models in RxODE. -
Pre-compile RxODE headers once (if cache is enabled), which increases compilation speed for models in RxODE
-
RxODE's translation from the mini-language to C has been refactored
-
Occasionally RxODE misidentified dual
lhs/paramvalues. An additional check is performed so that this does not happen. -
For solved matrices with similar names (like "tadd" and "tad") RxODE will now prefer exact matches instead of the first match found when accessing the items with
$tad. -
A fix where all ID information is kept with
keep=c(""..."") -
Transit compartment models using the
transitODE or variable are now allowed. Also check for more internally parsed items (see Issue #145). -
Bug fix for
etSeqandetRepwhere greater than 2 items were mis-calculated
- New plotting engine
- Various bug fixes for upcoming R 4.0 release:
- Dropped some imports for 21 imports restriction
- Fixed incompatibility with new
ggplot23.3.0 - Fixed allowing
NAs in RxODE dataset - Fixed setting all compartment default values for bioavailability, rate, etc.
- Added additional protection against floating point -> NaN for power functions
- Minor namespace/documentation changes for R 4.0 compatibility
- Added the ability to have an input parameter to be assigned to a new value (Issue #135)
- Added LINPACK authors as contributors
- Added a
NEWS.mdfile to track changes to the package