Skip to article content

Online Appendix

Abstract

This online appendix supplements the main text with algorithmic details and additional benchmarks. It presents pseudocode for value function iteration (VFI) and time iteration (TI), documents the speed-accuracy tradeoff these methods face, reports results with Howard policy improvement acceleration, provides equal-accuracy comparisons that hold solution quality constant while measuring computational cost, compares Euler error evaluation methods on the exogenous grid versus the ergodic distribution, and discusses the case ρ>1\rho > 1 (EIS <1< 1) where the transformed problem becomes a minimization.

Appendix: Alternative algorithms

Both value function iteration (VFI) and time iteration (TI) require numerical search at each grid point, unlike EGM which inverts the Euler equation analytically. Both methods face an inherent tradeoff: the certainty equivalent μ\mu must be evaluated at candidate consumption values during search. Two approaches exist: compute μ\mu exactly at each candidate (accurate mode), or precompute μ\mu on the asset grid and interpolate during search (fast mode).

Value function iteration. VFI finds optimal consumption by maximizing the Bellman equation directly:

V(m,z)=maxc[(1β)c1ρ+βμ(mc,z)1ρ]1/(1ρ)V(m, z) = \max_c \left[ (1-\beta) c^{1-\rho} + \beta \mu(m-c, z)^{1-\rho} \right]^{1/(1-\rho)}

where μ(a,z)=(E[V(Ra+y(z))1γz])1/(1γ)\mu(a, z) = \left( \mathbb{E}[V(Ra + y(z'))^{1-\gamma} | z] \right)^{1/(1-\gamma)} is the certainty equivalent. Golden-section search evaluates μ\mu at many candidate consumption values.

Time iteration. Time iteration (TI), introduced by Coleman (1991), works directly with the Euler equation rather than the Bellman equation. Like EGM, TI exploits the first-order condition; unlike EGM, it cannot invert the Euler equation analytically and must use numerical root-finding. Rendahl (2015) proves that under standard conditions, TI converges to the same solution as VFI. Coeurdacier et al. (2020) extend TI to Epstein-Zin preferences, treating consumption, value, and expected value as simultaneous controls; our accurate mode follows this approach by interpolating decision rules at each candidate consumption during root-finding.

Given current guesses (c(n),V(n))(c^{(n)}, V^{(n)}), TI finds consumption at each (m,z)(m, z) by solving the Euler equation via bisection, then updates the value function. The certainty equivalent uses VV directly: μ(a,z)=(E[V(m,z)1γ])1/(1γ)\mu(a, z) = (\mathbb{E}[V(m', z')^{1-\gamma}])^{1/(1-\gamma)}, exactly as in VFI.

Appendix: Speed-accuracy tradeoff

Table 1:Accurate-mode comparison: EZ-EGM vs numerical search (K=1K=1)

MethodTime (ms)Euler MeanEuler Max
EZ-EGM25-4.8-3.4
TI (accurate)2371-4.8-3.4
VFI (accurate)8385-3.5-2.3

Note: Grid size 100, K=1K=1 (no Howard acceleration). Accurate modes compute μ\mu exactly during search (no precomputation). Errors evaluated on uniform grid (εˉG\bar{\varepsilon}_G); see the main text for ergodic errors (εˉπ\bar{\varepsilon}_\pi).

Table 1 reveals two main findings. First, TI-accurate achieves the same accuracy as EZ-EGM (mean Euler error -4.8), confirming that when μ\mu is computed exactly during search, time iteration matches EGM’s precision. Second, this accuracy comes at substantial cost: TI-accurate is nearly 100 times slower than EZ-EGM, because bisection requires many μ\mu evaluations per grid point, each involving interpolation and expectation. VFI-accurate is slower still (over 300 times) yet less accurate than both EGM and TI, reflecting the underlying disadvantage of optimizing over the Bellman equation rather than working with the Euler equation.

EGM’s advantage is that it achieves accurate-mode precision at fast-mode speed by avoiding numerical search entirely. The main text compares EGM to the fast modes of VFI and TI, which represent practical implementations; this appendix shows that even the accurate modes cannot match EGM’s speed.

Appendix: Howard acceleration parameter

The main text reports baseline results without Howard acceleration (K=1K=1). This appendix examines how the choice of KK affects performance in both fast and accurate modes.

Note on iteration counts: For EGM, each “policy iteration” consists of one Euler equation inversion (the EGM step) plus up to KK value function updates. For TI, each policy iteration consists of one bisection solve at every grid point plus up to KK value updates. For VFI, each “policy iteration” consists of one numerical optimization over the consumption grid plus up to KK value function updates. All three methods use early termination: if the value function converges before KK updates, the remaining updates are skipped. The EGM policy step is analytic and thus much cheaper than VFI’s optimization or TI’s bisection.

EGM. EGM has no fast/accurate distinction because it evaluates μ\mu exactly on the endogenous grid.

Table 2:EZ-EGM: Effect of Howard acceleration parameter KK

KKTime (ms)Policy ItersEuler MeanEuler Max
125141-4.8-3.4
24999-4.9-3.4
36286-4.9-3.4
47078-4.9-3.4
57870-4.9-3.4

For EZ-EGM, K=1K=1 is fastest. Additional value iterations reduce policy iterations (from 141 to 70) but increase total time because the EGM policy step is already cheap and accurate. The slight accuracy improvement (-4.8 to -4.9) does not justify the 3x time increase.

VFI. VFI benefits substantially from Howard acceleration in both modes. The optimal K30K \approx 30-40 reduces time by 7x in fast mode and 13x in accurate mode.

Table 3:VFI fast mode: Effect of Howard acceleration parameter KK

KKTime (ms)Policy ItersEuler MeanEuler Max
11190239-3.3-2.4
1024731-3.3-2.4
2018316-3.3-2.4
3018111-3.3-2.4
401779-3.3-2.4
501938-3.3-2.4

Table 4:VFI accurate mode: Effect of Howard acceleration parameter KK

KKTime (ms)Policy ItersEuler MeanEuler Max
18385239-3.5-2.3
10131231-3.5-2.3
2080216-3.5-2.3
3064111-3.5-2.3
4062610-3.5-2.3
5065010-3.5-2.3

VFI-accurate benefits more from Howard than VFI-fast because each policy optimization is more expensive in accurate mode (computing μ\mu exactly versus interpolating). At K=40K=40, VFI-accurate (626ms) is faster than VFI-fast at K=1K=1 (1190ms), though still less accurate (-3.5 versus -3.3). This reflects the cost structure: golden-section search is the bottleneck, and reducing policy iterations helps more when each policy step is expensive.

TI. TI shows a distinctive pattern: moderate KK helps, but larger values hurt performance. The optimal KK differs between modes.

Table 5:TI fast mode: Effect of Howard acceleration parameter KK

KKTime (ms)Policy ItersEuler MeanEuler Max
1252140-3.2-2.7
2229100-3.2-2.7
321388-3.2-2.7
421381-3.2-2.7
5481174-3.2-2.7

Table 6:TI accurate mode: Effect of Howard acceleration parameter KK

KKTime (ms)Policy ItersEuler MeanEuler Max
12371141-4.8-3.4
2171698-4.9-3.4
3154086-4.9-3.4
4142778-4.9-3.4
5129070-4.9-3.4

TI-fast is optimal at K=3K=3-4, with time falling from 252ms to 213ms. Beyond K=4K=4, performance degrades sharply: K=5K=5 nearly doubles time to 481ms. This instability occurs because TI’s value function updates can overshoot when the policy is held fixed, destabilizing convergence.

TI-accurate is optimal at K=5K=5, with time falling from 2371ms to 1290ms, a 1.8x speedup. The higher optimal KK reflects the greater cost of each bisection step in accurate mode.

The contrast with VFI is instructive: VFI benefits from large KK (up to 30-50) because golden-section search produces noisier policy updates, requiring more value iterations to stabilize. TI’s bisection produces more accurate policies, reducing the benefit of additional value iterations and causing instability at high KK.

Appendix: Equal-accuracy comparison

The main text compares EZ-EGM and VFI at fixed grid size (100 points), where EGM is both faster and more accurate. A more informative comparison holds accuracy constant: what grid size does VFI require to match EGM’s Euler errors, and how do solve times compare?

We find grid sizes where mean Euler errors are approximately equal:

Table 7:Speed comparison at equal accuracy

VFI nnEGM nnMean ErrorVFI (ms)EGM (ms)Speedup
5020-3.26725145×\times
10020-3.312145261×\times
15020-3.417935386×\times
20020-3.522815490×\times
30025-3.634335627×\times

At equivalent accuracy levels, EZ-EGM is 150–630 times faster than VFI. The speedup grows with target accuracy: to achieve mean Euler error near -3.6, VFI requires 300 grid points while EGM needs only 25. Euler errors weighted by the ergodic distribution (5th–95th percentiles of simulated wealth) are similar to uniformly-weighted errors; the ergodic distribution concentrates wealth in the lower range (median around 3 versus grid maximum of 20), but both weighting schemes yield mean errors near -4.9.

These results use βR=0.98<1\beta R = 0.98 < 1, so agents converge to finite target wealth. For more impatient agents (βR0.92\beta R \approx 0.92), target wealth falls but accuracy remains similar. For very patient agents (βR1\beta R \geq 1), target wealth diverges and the grid must be extended accordingly; the accuracy comparison in that regime warrants separate investigation.

Appendix: Euler error evaluation methods

Two approaches exist for evaluating Euler equation errors: uniform grid evaluation and ergodic distribution weighting; we report both for completeness.

Standard approach (Santos 2000). Santos (2000) establishes the theoretical foundation for using Euler equation residuals to bound policy function errors. The standard implementation evaluates errors on a uniform grid spanning the state space, typically excluding boundary regions where the constraint binds. For our baseline (100 grid points), we evaluate at the 10th–90th percentiles of the grid:

εˉG=1G(m,z)Gε(m,z)\bar{\varepsilon}_G = \frac{1}{|G|} \sum_{(m,z) \in G} \varepsilon(m, z)

where GM×ZG \subset \mathcal{M} \times \mathcal{Z} is the set of interior grid points.

Ergodic distribution approach. An alternative evaluates errors at wealth levels agents actually visit in the long run. We simulate the ergodic distribution (10,000 agents, 500 periods, 200 burn-in) and compute errors at the 5th–95th percentiles of realized wealth:

εˉπ=1S(m,z)Sε(m,z)\bar{\varepsilon}_\pi = \frac{1}{|S|} \sum_{(m,z) \in S} \varepsilon(m, z)

where SπS \sim \pi is a sample from the stationary distribution π(m,z)\pi(m,z). This approach weights accuracy by economic relevance: errors at rarely-visited wealth levels matter less than errors where agents spend time.

Table 8:Euler errors by evaluation method (log10\log_{10})

εˉG\bar{\varepsilon}_G (grid)εˉπ\bar{\varepsilon}_\pi (ergodic)
MethodMeanMaxMeanMax
EZ-EGM-4.8-3.4-4.8-3.2
TI-3.2-2.7-3.6-2.7
VFI-3.3-2.4-3.3-2.3

Note: εˉG\bar{\varepsilon}_G evaluates at 10th-90th percentiles of grid (m[0.4,16.5]m \in [0.4, 16.5]). εˉπ\bar{\varepsilon}_\pi evaluates at 5th-95th percentiles of simulated wealth (m[0.7,9.6]m \in [0.7, 9.6]); median wealth 3\approx 3. Errors exclude constrained points where the Euler equation holds as inequality. All methods use fast mode (precomputed μ\mu).

For this calibration (βR=0.98<1\beta R = 0.98 < 1), the stationary distribution π\pi concentrates in the lower wealth range: the median is approximately m=3m = 3 versus the grid maximum of 20. Despite this difference in evaluation regions, EGM yields similar error statistics under both εˉG\bar{\varepsilon}_G and εˉπ\bar{\varepsilon}_\pi. TI shows improved accuracy under εˉπ\bar{\varepsilon}_\pi (-3.6 versus -3.2), suggesting its errors concentrate at high wealth levels that agents rarely visit.

EGM achieves the best accuracy because it satisfies the Euler equation by construction at the endogenous grid points; interpolation introduces error, but linear interpolation on a fine grid (100 points) keeps this small. TI and VFI both require numerical search, which compounds interpolation error. VFI shows the worst max error under εˉπ\bar{\varepsilon}_\pi (-2.3), reflecting that its optimization-based approach is less precise at low wealth levels where the policy function has higher curvature and agents spend the most time.

Appendix: Robustness to ρ>1\rho > 1

The baseline uses ρ=2/3\rho = 2/3 (EIS =1.5= 1.5), but the algorithm applies equally to ρ>1\rho > 1 (EIS <1< 1). We verify this by solving the same model with ρ{0.5,0.9,1.1,1.5,2,3}\rho \in \{0.5, 0.9, 1.1, 1.5, 2, 3\}, holding γ=10\gamma = 10 fixed. Across all values, EZ-EGM achieves mean Euler errors near -5 and max errors near -3.5 (in log10\log_{10} units). The case ρ>1\rho > 1 is empirically relevant: the meta-analysis of Havránek (2015) finds that micro estimates of the EIS often fall below unity.

When ρ>1\rho > 1, the transformation W=V1ρW = V^{1-\rho} is decreasing, so maximizing VV is equivalent to minimizing WW. No algorithmic modification is required: the first-order condition W/c=0\partial W / \partial c = 0 is sufficient and characterizes the optimum regardless of whether it is a maximum or minimum, and EGM inverts the Euler equation analytically. VFI is unaffected because it works with VV directly; the CES aggregator remains increasing in cc for all ρ1\rho \neq 1. Time iteration, like EGM, works with the Euler equation.

References
  1. Coleman, W. J. (1991). Equilibrium in a Production Economy with an Income Tax. Econometrica, 59(4), 1091–1104. 10.2307/2938175
  2. Rendahl, P. (2015). Inequality Constraints and Euler Equation-based Solution Methods. The Economic Journal, 125(585), 1110–1135. 10.1111/ecoj.12115
  3. Coeurdacier, N., Rey, H., & Winant, P. (2020). Financial Integration and Growth in a Risky World. Journal of Monetary Economics, 112, 1–21. 10.1016/j.jmoneco.2019.01.022
  4. Santos, M. S. (2000). Accuracy of Numerical Solutions Using the Euler Equation Residuals. Econometrica, 68(6), 1377–1402. 10.1111/1468-0262.00165
  5. Havránek, T. (2015). Measuring Intertemporal Substitution: The Importance of Method Choices and Selective Reporting. Journal of the European Economic Association, 13(6), 1180–1204. 10.1111/jeea.12133