Make alltest error

[jared-rescale]

Hello, I install firedrake and get a message saying it completed. When run make alltest I get the following message "Error: Firedrake venv not active."

[wence-]

After installation, you need to activate the virtual environment that we created during the install. Assuming you started in PWD and you're using bash, you need to do source PWD/firedrake/bin/activate before attempting to run anything.

[jared-rescale]

I do that, this error message comes up when running make alltests

On Tue, Feb 11, 2020 at 3:40 PM Lawrence Mitchell notifications@github.com wrote:

After installation, you need to activate the virtual environment that we created during the install. Assuming you started in PWD and you're using bash, you need to do source PWD/firedrake/bin/activate before attempting to run anything.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/firedrakeproject/firedrake/issues/1607?email_source=notifications&email_token=AM6FH6ZANWEQIVMTXDYGAT3RCMSOLA5CNFSM4KTIDWZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELOMBMQ#issuecomment-584892594, or unsubscribe https://github.com/notifications/unsubscribe-auth/AM6FH65DRX466VQMV5XFTOTRCMSOLANCNFSM4KTIDWZQ .

-- Jared Workman HPC Engineer

[jared-rescale]

Specifically - I install python3.7 via conda, install cmake 3-15, install firedrake to a successful completion message. Then I take a snapshot of this install that I attach to EC2 (amazon) volumes, I then upload a script that populates the proper environmental variables and then sources the script you mention above. I see the (firedrake) prompt at the beginning of each line but when I run make alltest I get the message posted above and then the make goes to completion with approximantely a 90% pass 10% fail rate. I'm not confident I have it set up properly. Do you have any suggestions or serial and parallel test scripts I can use to test functionality?

[wence-]

I think that error actually comes from our mistake, I think there are some things in flight to fix it. If around 90% pass then things are mostly installed. Can you provide the output that shows which tests fail?

[jared-rescale]

Sure what directory are the outputs from the tests in? I get roughly a 95% pass rate to make all test. Thanks, Jared

Dr. Jared Workman HPC Engineer Rescale

On Feb 13, 2020, at 5:04 PM, Lawrence Mitchell notifications@github.com wrote:

 I think that error actually comes from our mistake, I think there are some things in flight to fix it. If around 90% pass then things are mostly installed. Can you provide the output that shows which tests fail?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe.

[wence-]

Normally it just spews to screen. If you activate and run pytest /path/to/firedrake/tests --result-file=tests.log then tests.log contains the output.

[jared-rescale]

I feel like the majority of spewing refers to failed mpicxx compilations which would make sense. I install the program on a temporary. drive, take a snapshot of it, then move it over to cloud platforms. I have to recreate the environment each time and generally don't bother porting compilers over to the cloud as the bulk of our users will not be needing to figure out how to compile parallel programs. Let me try to run this over night and get it back to you.

The error seems to come from some join path with VIRTUAL_ENV, src, and pytest. It shows the environment is activated and seems to not effect the test results but I wanted to clarify this before I called it good.

Thanks again for your help.

On Thu, Feb 13, 2020 at 6:00 PM Lawrence Mitchell notifications@github.com wrote:

Normally it just spews to screen. If you activate and run pytest /path/to/firedrake/tests --result-file=tests.log then tests.log contains the output.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/firedrakeproject/firedrake/issues/1607?email_source=notifications&email_token=AM6FH6YSQVSJJNCEZCMRUM3RCXULDA5CNFSM4KTIDWZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELXFZ6Q#issuecomment-586046714, or unsubscribe https://github.com/notifications/unsubscribe-auth/AM6FH64CMB4QESZJDMXTF7LRCXULDANCNFSM4KTIDWZQ .

-- Jared Workman HPC Engineer

[jared-rescale]

src and petsc, sorry.

On Thu, Feb 13, 2020 at 6:00 PM Lawrence Mitchell notifications@github.com wrote:

Normally it just spews to screen. If you activate and run pytest /path/to/firedrake/tests --result-file=tests.log then tests.log contains the output.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/firedrakeproject/firedrake/issues/1607?email_source=notifications&email_token=AM6FH6YSQVSJJNCEZCMRUM3RCXULDA5CNFSM4KTIDWZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELXFZ6Q#issuecomment-586046714, or unsubscribe https://github.com/notifications/unsubscribe-auth/AM6FH64CMB4QESZJDMXTF7LRCXULDANCNFSM4KTIDWZQ .

-- Jared Workman HPC Engineer

[jared-rescale]

Here's some but not all of it. Do you have any sample programs I can use to test mpi functionality?

Thanks again, it was a 95 percent pass rate and most errors look like compiler errors rather than software errors.

Cheers. Jared

On Thu, Feb 13, 2020 at 6:00 PM Lawrence Mitchell notifications@github.com wrote:

Normally it just spews to screen. If you activate and run pytest /path/to/firedrake/tests --result-file=tests.log then tests.log contains the output.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/firedrakeproject/firedrake/issues/1607?email_source=notifications&email_token=AM6FH6YSQVSJJNCEZCMRUM3RCXULDA5CNFSM4KTIDWZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELXFZ6Q#issuecomment-586046714, or unsubscribe https://github.com/notifications/unsubscribe-auth/AM6FH64CMB4QESZJDMXTF7LRCXULDANCNFSM4KTIDWZQ .

-- Jared Workman HPC Engineer

firedrake) [udev-jared_QUxZk@ip-10-23-7-118 /program/firedrake/firedrake/src/firedrake]$ sudo make alltest out.txt Building extension modules Error: Firedrake venv not active. Linting firedrake codebase Linting firedrake test suite Linting firedrake scripts Running all regression tests ======================================================================================================================== test session starts ======================================================================================================================== platform linux -- Python 3.7.6, pytest-5.3.5, py-1.8.1, pluggy-0.13.1 rootdir: /program/firedrake/firedrake/src/firedrake, inifile: setup.cfg plugins: xdist-1.31.0, forked-1.1.3 collected 5716 items

tests/test_0init.py ... [ 0%] tests/test_tsfc_interface.py .......... [ 0%] tests/demos/test_demos_run.py F...s.s.s............ [ 0%] tests/equation_bcs/test_bcs_reconstruct.py . [ 0%] tests/equation_bcs/test_equation_bcs.py .......... [ 0%] tests/extrusion/test_2d_cohomology.py ...... [ 0%] tests/extrusion/test_annulus.py .. [ 0%] tests/extrusion/test_assembly.py ................................................................ [ 2%] tests/extrusion/test_bcs_interior_facet.py .. [ 2%] tests/extrusion/test_cellvolume_extrusion.py ................... [ 2%] tests/extrusion/test_cylinder.py .... [ 2%] tests/extrusion/test_dg_coords.py F. [ 2%] tests/extrusion/test_embedded_sphere_extrusion.py ........ [ 2%] tests/extrusion/test_enrichment_1_feec.py ......... [ 2%] tests/extrusion/test_extruded_cell_subdomains.py ...... [ 2%] tests/extrusion/test_facet_avg_extruded.py ...... [ 3%] tests/extrusion/test_facet_integrals_2D.py ....... [ 3%] tests/extrusion/test_facet_integrals_3D.py ....... [ 3%] tests/extrusion/test_facet_support_dofs.py ....... [ 3%] tests/extrusion/test_fs_abbreviations.py ............................................ [ 4%] tests/extrusion/test_galerkinproj.py ........................... [ 4%] tests/extrusion/test_geometric_strong_bcs_extrusion.py ................................ [ 5%] tests/extrusion/test_helmholtz_scalar.py ...... [ 5%] tests/extrusion/test_helmholtz_serendipity_2d.py ..... [ 5%] tests/extrusion/test_helmholtz_serendipity_3d.py .... [ 5%] tests/extrusion/test_helmholtz_vector.py ........ [ 5%] tests/extrusion/test_identity_extrusion.py ..........FF..FF..........FF..FF................................................ [ 6%] tests/extrusion/test_interior_facets_extr.py ........ [ 7%] tests/extrusion/test_interval.py ... [ 7%] tests/extrusion/test_kernel_int_cube.py . [ 7%] tests/extrusion/test_kernel_int_p0.py . [ 7%] tests/extrusion/test_kernel_intas_p0.py . [ 7%] tests/extrusion/test_kernel_intrhs.py . [ 7%] tests/extrusion/test_kernel_intvar_p0.py . [ 7%] tests/extrusion/test_laplace_neumann.py .......... [ 7%] tests/extrusion/test_meshes.py ...... [ 7%] tests/extrusion/test_mixed_bcs.py ................ [ 7%] tests/extrusion/test_mixed_mats_extrusion.py ....... [ 7%] tests/extrusion/test_mixed_periodic.py .... [ 8%] tests/extrusion/test_offset_computation.py .... [ 8%] tests/extrusion/test_point_eval_cells_extrusion.py ........... [ 8%] tests/extrusion/test_point_eval_fs_extrusion.py .................. [ 8%] tests/extrusion/test_poisson_neumann.py ...... [ 8%] tests/extrusion/test_poisson_strong_bcs_extrusion.py .. [ 8%] tests/extrusion/test_real_tensorproduct.py .................... [ 9%] tests/extrusion/test_rhs_bcs.py .. [ 9%] tests/extrusion/test_rhs_side_bcs.py .. [ 9%] tests/extrusion/test_serendipity_3d_polys.py .. [ 9%] tests/extrusion/test_side_strong_bcs.py ....... [ 9%] tests/extrusion/test_steady_advection_2D_extr.py ................ [ 9%] tests/extrusion/test_steady_advection_3D_extr.py ........................ [ 10%] tests/extrusion/test_strong_bcs_caching.py .. [ 10%] tests/extrusion/test_subdomain_extruded.py FF [ 10%] tests/extrusion/test_trace_extr.py .... [ 10%] tests/extrusion/test_two_step.py .. [ 10%] tests/extrusion/test_unit_square.py . [ 10%] tests/extrusion/test_variable_layers_bcs.py ............................ [ 10%] tests/extrusion/test_variable_layers_mesh_volume.py .. [ 10%] tests/extrusion/test_variable_layers_numbering.py ................... [ 11%] tests/extrusion/test_variable_layers_poisson.py . [ 11%] tests/extrusion/test_variable_layers_steady_advection.py . [ 11%] tests/extrusion/test_wedge_analytic.py .. [ 11%] tests/extrusion/test_zero_forms_extrusion.py . [ 11%] tests/extrusion/test_zero_integrand_extrusion.py . [ 11%] tests/multigrid/test_basics.py ........ [ 11%] tests/multigrid/test_custom_transfer.py .... [ 11%] tests/multigrid/test_embedded_transfer.py FFFFFFFFFFFFFFFFFFFFFFFF [ 11%] tests/multigrid/test_grid_transfer.py .................................................................................................................................................................................................................. [ 15%] tests/multigrid/test_invalid_transfers.py ... [ 15%] tests/multigrid/test_multi_space_transfer.py .. [ 15%] tests/multigrid/test_nested_split.py .. [ 15%] tests/multigrid/test_non_nested.py .. [ 15%] tests/multigrid/test_opencascade_poisson.py ssssss [ 15%] tests/multigrid/test_opencascade_volume.py ....... [ 15%] tests/multigrid/test_poisson_gmg.py ....... [ 15%] tests/multigrid/test_poisson_gmg_extruded.py ...... [ 16%] tests/multigrid/test_refine_then_solve.py . [ 16%] tests/multigrid/test_transfer_manager.py FF [ 16%] tests/multigrid/test_two_poisson_gmg.py ...... [ 16%] tests/output/test_config_exist.py . [ 16%] tests/output/test_dumb_checkpoint.py ............................ [ 16%] tests/output/test_hdf5file_checkpoint.py ...................... [ 17%] tests/output/test_one_dim_output.py ... [ 17%] tests/output/test_pvd_output.py ................................................................... [ 18%] tests/output/test_two_dim_output.py .... [ 18%] tests/randomfunctiongen/test_randomfunction.py .............................................................................................................................................................................................................. [ 22%] ....................................................................................................................................................................................................................... [ 25%] tests/randomfunctiongen/test_randomgen_compatibility.py ..................................................................................................................................................................................................... [ 29%] ............................................................................................................................................................................................................................................................. [ 33%] ............................................. [ 34%] tests/regression/test_2dcohomology.py ..................... [ 34%] tests/regression/test_adv_diff.py .... [ 34%] tests/regression/test_adv_diff_nonsplit.py .... [ 34%] tests/regression/test_appctx_cleanup.py . [ 34%] tests/regression/test_assemble.py ................................ [ 35%] tests/regression/test_assemble_inverse.py .... [ 35%] tests/regression/test_auxiliary_dm.py F [ 35%] tests/regression/test_bcs.py ...................................................................................... [ 37%] tests/regression/test_bubble.py F.. [ 37%] tests/regression/test_cell_subdomains.py ...... [ 37%] tests/regression/test_cellcoordinate.py ...... [ 37%] tests/regression/test_cellorigin.py .... [ 37%] tests/regression/test_cellvolume.py ................. [ 37%] tests/regression/test_change_coordinates.py ..... [ 37%] tests/regression/test_circle_manifold.py ......... [ 38%] tests/regression/test_coarse_nullspace.py . [ 38%] tests/regression/test_coefficient_derivatives.py . [ 38%] tests/regression/test_conditional.py .... [ 38%] tests/regression/test_constant.py ................ [ 38%] tests/regression/test_coordinatederivative.py F.... [ 38%] tests/regression/test_custom_callbacks.py . [ 38%] tests/regression/test_custom_pc_python_pmat.py .. [ 38%] tests/regression/test_dg_advection.py .... [ 38%] tests/regression/test_embedded_sphere.py ........ [ 38%] tests/regression/test_ensembleparallelism.py ..... [ 38%] tests/regression/test_exodus_mesh.py .. [ 38%] tests/regression/test_expressions.py ........................................................................................................................................................................................................................ [ 42%] ....................................................................................... [ 44%] tests/regression/test_facet_avg.py ......... [ 44%] tests/regression/test_facet_elements.py . [ 44%] tests/regression/test_facet_normal.py .... [ 44%] tests/regression/test_facet_orientation.py ..... [ 44%] tests/regression/test_facets.py ............................................ [ 45%] tests/regression/test_fas_snespatch.py ... [ 45%] tests/regression/test_fieldsplit_breadcrumbs.py . [ 45%] tests/regression/test_fs_caching.py ................ [ 45%] tests/regression/test_function.py ......... [ 45%] tests/regression/test_function_spaces.py ................................... [ 46%] tests/regression/test_geometric_strong_bcs.py ................................ [ 46%] tests/regression/test_helmholtz.py ........ [ 47%] tests/regression/test_helmholtz_bernstein.py ............ [ 47%] tests/regression/test_helmholtz_mixed.py .... [ 47%] tests/regression/test_helmholtz_nonlinear_diffusion.py .... [ 47%] tests/regression/test_helmholtz_serendipity.py ......... [ 47%] tests/regression/test_helmholtz_sphere.py ......... [ 47%] tests/regression/test_helmholtz_zany.py ...... [ 47%] tests/regression/test_hyperelasticity.py . [ 47%] tests/regression/test_identity.py ........ [ 48%] tests/regression/test_import_applications.py ss [ 48%] tests/regression/test_info.py . [ 48%] tests/regression/test_interior_elements.py . [ 48%] tests/regression/test_interior_facets.py ......... [ 48%] tests/regression/test_interpolate.py ........F........................ [ 48%] tests/regression/test_interpolate_zany.py ........ [ 48%] tests/regression/test_ip_viscosity.py .F........ [ 49%] tests/regression/test_jacobian_invalidation.py . [ 49%] tests/regression/test_l2pullbacks.py FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF [ 49%] tests/regression/test_linear_solver_change_bc.py . [ 49%] tests/regression/test_locate_cell.py .................... [ 50%] tests/regression/test_manifolds.py .......... [ 50%] tests/regression/test_manual_quadrature.py . [ 50%] tests/regression/test_matrix.py . [ 50%] tests/regression/test_matrix_free.py ..................................................... [ 51%] tests/regression/test_matrix_prefix.py ...... [ 51%] tests/regression/test_mesh_generation.py ............................................................................... [ 52%] tests/regression/test_mesh_overlaps.py ......... [ 52%] tests/regression/test_mixed_interior_facets.py .... [ 53%] tests/regression/test_mixed_mats.py ........ [ 53%] tests/regression/test_mixed_tensor.py . [ 53%] tests/regression/test_moore_spence.py s [ 53%] tests/regression/test_multiple_domains.py ........................................ [ 53%] tests/regression/test_nested_fieldsplit_solves.py .......... [ 54%] tests/regression/test_nonlinear_helmholtz.py ... [ 54%] tests/regression/test_nonlinear_stokes_hdiv.py . [ 54%] tests/regression/test_norm.py ....... [ 54%] tests/regression/test_nullspace.py ........ [ 54%] tests/regression/test_octahedral_hemisphere.py ...... [ 54%] tests/regression/test_p1pc.py ... [ 54%] tests/regression/test_par_loops.py ................ [ 54%] tests/regression/test_parallel_cr.py . [ 54%] tests/regression/test_parallel_kernel.py . [ 54%] tests/regression/test_parameters.py .. [ 54%] tests/regression/test_partially_mixed_mat.py .... [ 54%] tests/regression/test_patch_pc.py ........................ [ 55%] tests/regression/test_patch_precompute_element_tensors.py . [ 55%] tests/regression/test_periodic_2d.py .................................... [ 56%] tests/regression/test_periodic_interval_advection.py ........ [ 56%] tests/regression/test_periodic_rectangle_advection.py ............. [ 56%] tests/regression/test_piola_mixed_fn.py .. [ 56%] tests/regression/test_point_eval_api.py ...... [ 56%] tests/regression/test_point_eval_cells.py ............ [ 56%] tests/regression/test_point_eval_fs.py .....F........................... [ 57%] tests/regression/test_poisson_mixed_no_bcs.py ... [ 57%] tests/regression/test_poisson_mixed_strong_bcs.py ....... [ 57%] tests/regression/test_poisson_sphere.py ...... [ 57%] tests/regression/test_poisson_strong_bcs.py ................. [ 57%] tests/regression/test_poisson_strong_bcs_nitsche.py .... [ 57%] tests/regression/test_projection.py ...FFF...FFF...FFF.........F........ [ 58%] tests/regression/test_projection_zany.py .... [ 58%] tests/regression/test_python_parloop.py ..... [ 58%] tests/regression/test_quadrature.py . [ 58%] tests/regression/test_real_space.py ............... [ 59%] tests/regression/test_scaled_mass.py ........................................................................................................................................................................................................................ [ 62%] ............................................................................................................................................................................................................................................................. [ 67%] ....................................................................................................................................................................................................................... [ 71%] tests/regression/test_slepc.py s. [ 71%] tests/regression/test_solver_error_checking.py ........... [ 71%] tests/regression/test_solvers_options_prefix.py ........... [ 71%] tests/regression/test_solving_interface.py ........ [ 71%] tests/regression/test_split.py ... [ 71%] tests/regression/test_split_communicators.py . [ 71%] tests/regression/test_steady_advection_2D.py ................ [ 71%] tests/regression/test_steady_advection_3D.py .... [ 72%] tests/regression/test_stokes_hdiv_parallel.py ...... [ 72%] tests/regression/test_stokes_mini.py .. [ 72%] tests/regression/test_subdomain.py FFFFFF [ 72%] tests/regression/test_subdomain_integrals.py ........ [ 72%] tests/regression/test_taylor.py F [ 72%] tests/regression/test_tensor_algebra.py ..................... [ 72%] tests/regression/test_trace_galerkin_projection.py ............ [ 72%] tests/regression/test_ufl.py ......... [ 73%] tests/regression/test_upwind_flux.py .... [ 73%] tests/regression/test_vector.py .............. [ 73%] tests/regression/test_vector_laplace_on_quadrilaterals.py .... [ 73%] tests/regression/test_vertex_based_limiter.py .........F [ 73%] tests/regression/test_vfs_component_bcs.py ........................... [ 74%] tests/regression/test_work_functions.py ......... [ 74%] tests/regression/test_zero_forms.py ......................................................................................................................................................................................................................... [ 78%] ............................................................................................................................................................................................................................................................. [ 82%] ............................................................................................................................................................................................................................................................. [ 86%] ................................................................................... [ 88%] tests/regression/test_zero_integrand.py . [ 88%] tests/slate/test_assemble_tensors.py ...F...F...F...F...F...F...F...F...F...F...F...F...F...F...F...F.FF.F.FF.FF.F.FF [ 89%] tests/slate/test_darcy_hybridized_mixed.py FF [ 89%] tests/slate/test_facet_tensors.py F.FF.F [ 89%] tests/slate/test_facet_tensors_extr.py F.F.FFF.FF.F.FFF.F [ 90%] tests/slate/test_hdg_poisson.py FFFF [ 90%] tests/slate/test_hybrid_poisson_sphere.py FF [ 90%] tests/slate/test_linear_algebra.py FFFFFFFFFFFFFFFFFF... [ 90%] tests/slate/test_matrix_free_hybridization.py F [ 90%] tests/slate/test_mimetic.py FFFFFFFFFFFFFF [ 91%] tests/slate/test_orientations.py FFF [ 91%] tests/slate/test_scalar_tensors.py ................................................................................................................................................ [ 93%] tests/slate/test_scalar_tensors_extr.py . [ 93%] tests/slate/test_slac.py ................................................ [ 94%] tests/slate/test_slac_parallel.py F [ 94%] tests/slate/test_slate_hybridization.py FFFF [ 94%] tests/slate/test_slate_hybridization_extr.py FF [ 94%] tests/slate/test_slate_hybridized_mixed_bcs.py FFFFFF [ 94%] tests/slate/test_slate_infrastructure.py ............................................................................. [ 96%] tests/slate/test_subdomains.py FFFFFFFFFFFFFFFFFFFFFFFFFFF [ 96%] tests/slate/test_unaryop_precedence.py . [ 96%] tests/slate/test_variational_prb.py FF [ 96%] tests/slate/test_zany_element_tensors.py FFFF

[dham]

Hi Jared,

We do provide Firedrake Docker containers. Would that be an easier way for you to have Firedrake in the cloud?

Regards,

David

[jared-rescale]

Let me check. I don’t know much about docker or its interface with our platform. Did you see anything obvious from the errors?

Thanks, Jared.

Dr. Jared Workman HPC Engineer Rescale

On Feb 14, 2020, at 9:34 AM, David A. Ham notifications@github.com wrote:

 Hi Jared,

We do provide Firedrake Docker containers. Would that be an easier way for you to have Firedrake in the cloud?

Regards,

David

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe.