----------------------------------------------------------------------------
-SimGrid (3.23.3) NOT RELEASED YET (v3.24 expected September 23. 7:50 UTC)
+SimGrid (3.25.1) UNRELEASED (target: March 20 2020 or v3.26 on 3/26/20)
+
+Important user-visible changes:
+ - Surf precision default value is now 1e-9, instead of 1e-5. This was changed as
+ several users had difficult to understand issues when using high bandwidth or
+ small latency events. The new value was already the default for SMPI and
+ should not cause too much performance hit. It can change some simulation
+ timings if simulation was skipping a lot of small events (which was actually
+ an issue of said simulation). The value can still be changed back using
+ --cfg=surf/precision:1e-5.
+ - On some network models (L07, CM02, LV08), an implicit loopback link is created
+ for local communication. Default bandwidth was 500MBps and latency was 15µs,
+ which was rather bad. Default values have been changed to 10GBps and 0 latency.
+ Options network/loopback-lat and network/loopback-bw have been added to adapt
+ these values if needed. Network and routing models already providing separate
+ loopbacks (clusters and such) are not impacted by this change.
+
+General:
+ - LTO is now enabled for Intel/clang compilers.
+ - LTO behavior on GCC can be parameterized using LTO_EXTRA_FLAG in cmake.
+ Setting it to "auto" will use all available cores, while setting it to n will
+ use n cores to speedup link step (usage: cmake -DLTO_EXTRA_FLAG=4).
+
+C interface:
+ - Many MSG tests were converted to the new S4U's interface in C, that
+ was extended for that.
+
+Fixed bugs (FG#.. -> FramaGit bugs; FG!.. -> FG merge requests)
+ (FG: issues on Framagit; GF: issues on GForge; GH: issues on GitHub)
+ - FG#41: Add sg_actor_create C interface
+ - FG#43: xbt::random needs some care
+ - FG#48: The Impossible Did Happen (yet again)
+ - FG!24: Documentation and fix for xbt/random
+ - GF#18137: Allow different stack sizes?
+ - GH#128: Parallelization of simulation with --cfg=contexts/nthreads
+ - GH#139: Allow pthread creation in SMPI
+ - GH#336: Packet-level simulation using SMPI?
+
+----------------------------------------------------------------------------
+
+SimGrid (3.25) February 2. 2020 (aka 02 02 2020)
+
+The Palindrom Day Release.
+
+Important user-visible changes:
+ - Improve the Python usability (stability and documentation).
+ - A nasty synchronization bug was ironed out, see also below.
+ - Python's doc was organized as a separate tree, now integrated with C++.
+ - C bindings of S4U were not part of the doc.
+ - The C++ doc was also improved as methods are now split by theme.
+ - Further deprecate MSG: you now have to pass -Denable_msg=ON to cmake.
+ - This is mandatory to use the Java bindings.
+ - OFF by default; The plan is to completely remove MSG by 2020Q4 or 2021Q1.
+ - SimDAG++: Automatic dependencies on S4U activities (experimental)
+ - Some features are already implemented but not all of them
+ - Cannot block an activity until it's scheduled on a resource
+ - No heterogeneous wait_any() that would mix Exec/Comm/Io activities.
+ - See examples/s4u/{io,exec,comm}-dependent for what's already there.
+
+General:
+ - Upgrade documented Java dependency to Java 8 (earlier versions don't work).
+ - Drop support for Viva/Triva (old visualization tools), hence removed
+ TRACE_get_node_types() and TRACE_get_edge_types() functions.
+
+Python:
+ - Require pybind11 version 2.4.
+ - Greatly improve locking during context switches with Python.
+ - Declaring Python callbacks to this_actor::on_exit is now working.
+ - No more tests are failing currently, even on win32.
+
+S4U:
+ - Actor: Merge signals on_migration_start/end into on_host_change
+ - Actor: Rename migrate() into set_host()
+ - Disk: Allow users to get the read and write nominal bandwidth values
+ - Exec: Implement wait_for(timeout)
+ - Io: Implement wait_for(timeout)
+
+XML:
+ - Parse errors now raise a simgrid::ParseError that you may want to catch.
+
+Kernel:
+ - In simgrid::kernel::resource::Model, the methods next_occuring_event*() have
+ been renamed to fix a spelling error. As usual, the previous definitions are
+ kept with a deprecation warning. However, to avoid runtime errors, it is now
+ forbidden to override these deprecated methods in a derived class. Please use
+ the new names immediately if you need to override them.
+
+XBT:
+ - Remove unused parameter 'free_ctn' for xbt_dict_set() and xbt_dict_set_ext().
+ - Drop unused functions for dicts and dynars: xbt_dict_cursor_get_elm,
+ xbt_dict_get, xbt_dict_get_elm, xbt_dict_get_ext, xbt_dict_get_key,
+ xbt_dict_remove, xbt_dict_reset, xbt_dynar_compare, xbt_dynar_dump,
+ xbt_dynar_foreach_ptr, xbt_dynar_free_data, xbt_dynar_free_voidp,
+ xbt_dynar_init, xbt_dynar_insert_at_as, xbt_dynar_merge,
+ xbt_dynar_remove_n_at, xbt_dynar_replace, xbt_dynar_search, xbt_dynar_set.
+ - New module: random, providing classical random numbers generators.
+
+SMPI:
+ - New option : "smpi/auto-shared-malloc-thresh" which sets a value for
+ allocations' size above which they are considered "shared" by default (as if
+ they were performed through SMPI_SHARED_MALLOC macros).
+ Default = 0 = disabled feature.
+ Note : malloc, calloc and free are now overriden by smpicc/cxx by default.
+ This can cause some troubles if codes are already overriding these. If this
+ is the case, defining SMPI_NO_OVERRIDE_MALLOC in the compilation flags can
+ help, but will make this feature unusable.
+ - Input check is now performed much more consistently and outputs precise
+ warnings for each error found
+ - New supported calls : MPI_File_set_view, MPI_File_get_view
+ - MPI I/O now only supports disks, as storage is discontinued.
+ - MPI I/O allows opening files without specifying absolute path
+ - Note : SMPI configuration options are now initialized by smpi_init_options()
+ call, which should be called if SMPI is not being used through smpirun.
+
+Fixed bugs (FG#.. -> framagit bugs; FG!.. -> framagit merge requests):
+ - FG#9: Python bindings crashing
+ - FG#39: Missing s4u::Comm::wait_any_for example
+ - FG#42: Add support for ThreadSanitizer (TSan)
+ - FG!19: Removing RngStream
+ - FG!20: A module for RNG calls
+ - FG!21: Choice between ad-hoc and standard distributions implementations
+ - FG!23: Master
+ - FG!25: Fix link in Mutex doc
+ - FG!26: Fix links in SMPI interface doc
+ - GH#31: [MC] please provide an option to make MPI_Send asynchronous
+ - GH#305: Unscheduled tasks are still excuted
+ - GH#313: smpirun: manual outdated w.r.t. --help
+ - GH#321: [S4U] Get task remaining work ratio
+ - GH#323: Crash when an actor turn off his physical host
+ - GH#335: Missing links on dragonfly example svg
+ - https://lists.gforge.inria.fr/pipermail/simgrid-user/2019-November/004653.html:
+ MPI_Cart_sub was not working properly. Kudos to Jonathan Borne for the report.
+
+----------------------------------------------------------------------------
+
+SimGrid (3.24) October 9. 2019
+
+The Clean Disk Release.
S4U:
+ - Introduce a s4u::Disk interface to manage the newly introduced <disk>
+ tag. s4u::Disk is called to supplant s4u::Storage in a near future. It
+ thus becomes the default resource to execute I/O operations. Examples
+ and the file system plugin have been modified to use disks instead of
+ storage elements. Storage can still be used but is doomed to disappear.
+ Users are thus adviced to update their simulators accordingly.
- Barrier::wait returns SG_BARRIER_SERIAL_THREAD for (only) one actor
for consistency with pthread_barrier_wait()
- Host::get_englobing_zone() returns the englobing netzone
- Actor::on_destruction is now called in the destructor
Actor::on_termination new signal called when the actor terminates
its code.
+ - Global signals are now part of the Engine:
+ - on_platform_creation: after config settings, before the XML parsing
+ - on_platform_created: right after the XML parsing
+ - on_time_advance: each time the clock advances
+ - on_simulation_end: after simulation, before cleanups
+ - on_deadlock: as the name implies.
+ - C bindings:
+ - sg_{actor,host,link}_{data,data_set}() now all exist.
+ Use them to attach user data to the object and retrieve it.
+
+Models:
+ - Introduce an experimental Wifi model. It sounds reasonable
+ according to the state of the art, but it still has to be properly
+ validated, at least against ns-3 if not against reality.
+ - Improved the usability of ns-3. Several bugs were ironed out.
+ - host_energy: Wattage was expressed as 'idle:oneCore:allCores'.
+ It is now expressed as 'idle:epsilon:allCores' to properly model the
+ consumption of non-whole tasks on mono-core hosts. More info in the doc.
MSG:
- convert a new set of functions to the S4U C interface and move the old MSG
SMPI:
- Fortran bindings for DVFS have been removed.
- - Add support for MPI_Irsend, MPI_Rsend, MPI_Rsend_init
+ - Add support for MPI_Irsend, MPI_Rsend, MPI_Rsend_init, MPI_Bsend,
+ MPI_Ibsend, MPI_Bsend_init, MPI_Buffer_attach, MPI_Buffer_detach
- SMPI can now be selected by cmake's find_module(MPI) with
MPI_C_COMPILER, MPI_CXX_COMPILER, MPI_Fortran_COMPILER variables.
- Add support for MPI Errhandlers in Comm, File or Win. Default errhandler is now
MPI_ERRORS_ARE_FATAL, so codes which were sending warnings may start failing.
+ - trace-call-location can be used with TI traces, and replayed, and is compatible
+ with smpi/comp-adjustment-file.
+ - sleep events are now correctly traced/replayed.
+ - Default for trace-call-location is now to use file names and not full paths.
+ To revert to previous behavior (in case of collision of filenames), option
+ "smpi/trace-call-use-absolute-path" can be set to yes.
Model-Checker:
+ - Use the included xxHash as an hash implem when C++14 is usable.
- Option model-checker/hash was removed. This is always activated now.
- New option smpi/buffering controls the MPI buffering in MC mode.
- - MPI calls now MC_assert() that no MPI_ERR_* code is returned.
+ - MPI calls now MC_assert() that no MPI_ERR_* code is returned.
This is useful to check for MPI compliance.
+Documentation:
+ - New section on plugins: how to define a new one, and existing ones.
+
XBT:
- xbt_mutex_t and xbt_cond_t are now marked as deprecated, a new C interface
- on S4U is already available to replace them by sg_mutex_t and sg_cond_t.
-
-Bugs:
+ on S4U is already available to replace them by sg_mutex_t and sg_cond_t.
+
+XML:
+ - Introduce the <disk> tag as a replacement of the <storage>, <storage_type>,
+ and <mount> tags. The rationale is finish to decouple what should be handle
+ by SimGrid kernel (i.e., resources and activities) from plugins built in
+ user space (e.g., the file system plugin). This new tag currently accepts
+ only three attributes (id, read_bw, and write_bw). All the other information
+ that was declared with the storage related tags now has to be expressed as
+ properties. An example of platform using this new tag is available at
+ examples/platforms/hosts_with_disks.xml
+
+tesh:
+ - 'expect signal' can now accept more than one potential signal.
+
+Fixed bugs (FG#.. -> framagit bugs; FG!.. -> framagit merge requests):
- FG#28: add sg_actor_self (and other wrappers on this_actor methods)
- - FG#29 and FG#33: provide a new C API to mutexes and condition variables
+ - FG#29 and FG#33: provide a new C API to mutexes and condition variables
- FG#30: convert MSG_process_{un}ref to sg_actor_{un}ref
+ - FG#31: per-actor data
- FG#34: SG_BARRIER_SERIAL_THREAD?
- FG#35: model-checker does not like buster-produced binaries
+ - FG!13: MC: complete workaround in the error msg seen on modern systems
+ - FG!15: execute_flops now logs compute
+ - FG!16: Fix the ns-3 bindings when several flows are simultaneously finishing
+ - FG!17: ns-3: unblock the right number of communications + others issues
+ - FG!18: Improving the performance of the ns-3 bindings
+ - GH#189: Energy consumption of parallel tasks
+ - GH#219: Error in the throughput of TCP transfer
+ - GH!330: Minor polishing of English: Configuring_Simgrid
+ - GH!331: Fix a doc error about actors (Tutorial_algorithms)
+ - GH!332: Add '-O0' flag for: cmake -DCMAKE_BUILD_TYPE=Debug
+ - GH!334: Rework energy plugin, again
----------------------------------------------------------------------------
- #230: segfaults when exit() without run()
- #225: s4u::Actor::kill() doesn not really kill victims in a join()
- #223: MSG_task_get_flops_amount() not working with parallel tasks
- - #222: Actor::kill() doesn't really kill and segfaults
+ - #222: Actor::kill() doesn't really kill and segfaults
- #221: odd LMM warning when killing an actor
- #120: Memory leak when the processes are forcefully killed
MSG_environment_as_get_property_value().
- Removed MSG_as_router_*propert*() functions
- Added MSG_environment_as_set_property_value() for consistency
- * xbt heterogeneous dictionnaries (created with xbt_dict_new()).
+ * xbt heterogeneous dictionaries (created with xbt_dict_new()).
Well, they are still there for now, but deprecated with a warning.
Please switch to xbt_dict_new_homogeneous() before this is removed
for real.
* New module: org.simgrid.msg.File (SimGrid File management functions)
* New Module: org.simgrid.msg.VM (SimGrid interface to mimick IAAS clouds)
* Change the meaning of Process.restart: now restart the process from
- the begining, like MSG_process_restart in C.
+ the beginning, like MSG_process_restart in C.
* Add Process.setAutoRestart: handling of process restart when failed
host comes back.
* Add Process.getProperty, Host.getProperty, Host.getProperty: allows
* Fix a bug preventing the tasks from begin garbage collected.
MSG
- * Fix a bug occuring when a host involved in a communication fails.
+ * Fix a bug occurring when a host involved in a communication fails.
This was not detected properly by the other peer involved in the
communication. Now, it's reported as a network error.
o network_model -> network/model
o workstation_model -> workstation/model
* New configuration variables:
- o network/bandwidth_factor: correction to bandwith
+ o network/bandwidth_factor: correction to bandwidth
o network/latency_factor: correction to latency
o netwotk/weight_S: correction to the weight of competing streams
* Add a long description to the models, that users can see with such
- SD_task_create_comm_e2e() for end-to-end communication
- SD_task_create_comp_seq() for sequential computation
Use SD_task_schedulev() / SD_task_schedulel() to schedule them.
- * new function SD_task_dump() for debuging display
+ * new function SD_task_dump() for debugging display
* new function SD_task_dotty(task,FILE*) writing to file the info
about the task in dotty format
* SD_task_dependency_exists() can now cope with having one of its
kind of action while the second one parses a trace file and
triggers the corresponding actions within the system.
For now, only a toy example is provided in examples/msg/actions
- * Add an exemple of process migration in examples/msg/migration
+ * Add an example of process migration in examples/msg/migration
* Fix a bug in task exchange which broke MSG_task_get_sender()
Add a teshsuite regression test for that.
[Bug: if MSG_task_get_sender() is called after sender exit,
**************************************
*DO NOT MIX 3.2 RESULTS WITH 3.3 ONES* Simix may changes simulations!
**************************************
- The point is that events occuring at the exact same timestamp are
+ The point is that events occurring at the exact same timestamp are
not scheduled in the same order with the old and new version. This
may be enough to completely change the execution of simulations in
some cases. Sorry for the inconvenience.
. Lesson 8: Handling errors through exceptions
. Lesson 9: Exchanging simple data
. Lesson 10: Remote Procedure Calling (RPC)
- . Lesson 11: Explicitely waiting for messages
+ . Lesson 11: Explicitly waiting for messages
. Recapping of message passing features in GRAS
- A HOWTO section containing:
o HOWTO design a GRAS application
in progress and the API is not considered to be frozen yet). [AL]
* Display more information on backtraces: source line & function names are
now displayed just like valgrind does (rely on addr2line tool) [MQ]
- * New function: xbt_backtrace_display(). Sweet while debuging [MQ]
+ * New function: xbt_backtrace_display(). Sweet while debugging [MQ]
* Reworked a little bit some #include statements to load only required
headers. Some user code that relied on SimGrid to include stdlib or
stdio may need to include it by themselves. [AL]
- reduces the amount of exchanged data (the size)
- allows to retrieve all arrived data on receiver side, if we don't need
it right now (subsequent read will peek the buffer)
- - allows the receiver to proceed with the begining of the stream before
+ - allows the receiver to proceed with the beginning of the stream before
everything is arrived
- make it possible to build an iov transport (using readv/writev)
Extra difficulty:
- s_toto is a structure needing 'struct' keyword to be used
- e_toto_t is an enum
- toto_t is an 'object' (struct*)
- Exemple:
+ Example:
typedef struct s_toto {} s_toto_t, *toto_t;
typedef enum {} e_toto_t;
Moreover, only toto_t (and e_toto_t) are public. The rest (mainly
- In composed data description (struct, ref and so on), stop foolness of
keeping the subtype's ID, but store the type itself. This keeps sets out
of the critical path, which is good since they rely on dynar and
- dictionnaries. The only loose of that is that we cannot detect the
+ dictionaries. The only loose of that is that we cannot detect the
redeclaration of a structure/union with another content (but I'm not sure
the code detected well this error before anyway). We still can detect
the redefinition discrepancy for the other types.
for now.
[Transport]
[File plugin]
- - Bugfix when using a filename explicitely (instead of '-')
+ - Bugfix when using a filename explicitly (instead of '-')
2004-04-09 Martin Quinson
[Transport plugins]